-- Logs begin at Thu 2022-05-12 16:15:25 UTC, end at Thu 2022-05-12 17:34:49 UTC. -- May 12 17:06:59.491849 dv-cinder-841591-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 17:06:59.500069 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:06:59 2022] *** May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: nodename: dv-cinder-841591-1-iscsi May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: machine: x86_64 May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: clock source: unix May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: pcre jit disabled May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: detected number of CPU cores: 4 May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: current working directory: / May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: detected binary path: /usr/bin/uwsgi-core May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: your processes number limit is 47680 May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: your memory page size is 4096 bytes May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: detected max file descriptor number: 2048 May 12 17:06:59.502126 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: lock engine: pthread robust mutexes May 12 17:06:59.503564 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: thunder lock: enabled May 12 17:06:59.503564 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 17:06:59.503564 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:06:59.548190 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: Python main interpreter initialized at 0x561506f439c0 May 12 17:06:59.548190 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: python threads support enabled May 12 17:06:59.548190 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: your server socket listen backlog is limited to 100 connections May 12 17:06:59.548190 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: your mercy for graceful operations on workers is 90 seconds May 12 17:06:59.548515 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:06:59.548591 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: *** Operational MODE: preforking *** May 12 17:06:59.548848 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: *** uWSGI is running in multiple interpreter mode *** May 12 17:06:59.548848 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: spawned uWSGI master process (pid: 102725) May 12 17:06:59.549028 dv-cinder-841591-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 17:06:59.552260 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: spawned uWSGI worker 1 (pid: 102726, cores: 1) May 12 17:06:59.552260 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: spawned uWSGI worker 2 (pid: 102727, cores: 1) May 12 17:06:59.552260 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:07:00.740710 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:07:00.754129 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:07:01.472994 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:07:01.472994 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: from cryptography.utils import int_from_bytes May 12 17:07:01.474943 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:07:01.474943 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: from cryptography.utils import int_from_bytes May 12 17:07:01.475247 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:07:01.475247 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: from cryptography.utils import int_from_bytes May 12 17:07:01.475576 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:07:01.475576 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: from cryptography.utils import int_from_bytes May 12 17:07:04.030360 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:07:04.031065 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:07:04.031169 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:07:04.031495 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:07:04.031754 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:07:04.031980 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:07:04.032335 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.032425 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:07:04.032514 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.032773 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:07:04.032883 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.033104 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.033193 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:07:04.033382 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:07:04.033482 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.033736 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.033831 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.034060 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.034146 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.034383 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.034515 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.034747 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.034842 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035009 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035178 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035326 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035425 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035653 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-1-iscsi {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035748 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.035978 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036082 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036288 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036375 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036574 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036667 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036895 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.036990 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.037198 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.037293 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-1-iscsi {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.037522 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.037615 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.037829 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.037926 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.038151 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.038325 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.038494 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.039518 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.039676 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.039794 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.039889 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040024 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040149 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040238 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040327 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040429 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040516 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040601 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040686 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040776 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040856 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.040989 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.041131 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.041222 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.041450 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.041554 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.041765 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.041898 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-1-iscsi {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.042088 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.042221 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.042401 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.042561 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.042756 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.042912 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.043073 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.043275 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.043469 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-1-iscsi {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.043588 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.043789 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.043888 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.044107 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.044195 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.044438 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.044582 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.044811 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.044921 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.045138 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.045233 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.045449 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.045542 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.045765 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.045874 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.046089 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.046191 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.046405 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.046528 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.046731 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.046828 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.047040 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.047134 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.047358 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.047455 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.048173 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.048273 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.048480 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.048581 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.048732 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.048825 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049039 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049131 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049360 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049461 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049688 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049780 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.049998 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050091 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050248 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050340 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050532 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050641 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050854 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.050952 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.051176 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.051270 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.051486 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.051579 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.051752 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.051849 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052007 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052112 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052330 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052424 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052654 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.052968 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053088 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053271 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053364 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053577 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053672 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053885 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.053975 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.054194 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.054290 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.054531 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.054622 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.054841 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.054929 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.055149 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.055233 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.055470 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.055558 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.055788 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.055875 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.056097 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.056195 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.056409 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.056500 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.056733 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.056827 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057038 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057124 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057360 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057456 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057673 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057764 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.057980 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.058072 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.058289 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.058386 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.058619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.058707 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.058941 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059035 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059267 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059353 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059576 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059659 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059826 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.059920 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.060128 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.060222 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.060435 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.060522 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.060755 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.060857 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061157 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061337 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061427 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061643 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061822 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.061950 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062042 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062258 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062351 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062590 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062693 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062900 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.062999 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.063211 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.063341 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.064091 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.064188 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.064406 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.064491 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.064718 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.064817 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065031 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065118 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065344 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065430 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065655 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065780 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.065965 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.066079 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.066268 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.066385 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.066602 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.066691 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.066911 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067004 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067220 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067314 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067544 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067643 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067853 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.067946 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.068162 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.068249 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.068470 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.068569 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.068780 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.068866 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.069083 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.069169 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.069404 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.069497 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.069713 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.069798 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070017 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070108 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070336 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070451 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070662 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070750 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.070973 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071060 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071285 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071382 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071592 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071686 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071900 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.071993 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.072202 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.072299 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.072505 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.072597 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.072811 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.072904 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.073116 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.073229 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.073422 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.073532 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.073723 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.073808 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074021 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074107 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074325 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074409 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074660 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074756 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.074968 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075064 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075275 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075360 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075579 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075669 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075896 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.075983 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.076218 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.076302 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.076529 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.076615 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.076839 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.076926 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.077145 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.077237 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.077467 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:07:04.077562 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.077805 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.077890 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.078124 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.078220 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.078450 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.078601 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.078771 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.078858 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.079129 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.079223 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.079446 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.079541 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.079767 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.079853 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.080081 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.080175 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.080404 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.080495 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.080720 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.080804 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081038 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081121 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081354 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081440 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081669 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081764 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.081990 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.082085 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.082301 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.082396 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.082658 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.082753 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.082978 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.083064 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.083299 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.083387 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.083612 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.083701 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.083925 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084017 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084249 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084342 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084583 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084676 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084906 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.084991 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.085220 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.085306 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.085531 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.085618 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.085844 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.085937 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.086156 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.086243 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.086500 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.086612 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.086842 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.086938 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.087158 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.087245 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.087473 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.087566 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.087786 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.087883 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.088100 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.088194 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.088413 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.088499 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.088730 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.088839 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089058 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089152 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089358 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089442 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089679 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089831 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.089975 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.090108 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.090293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.090448 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.090635 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.090771 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.090951 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.091086 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.091267 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.091400 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.091580 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.091717 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.091887 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092023 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092194 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092338 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092483 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092625 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092795 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.092927 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.093099 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.093235 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.093406 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.093549 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.093716 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.093806 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.094023 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.094119 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.094334 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.094474 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.094693 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.094779 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095017 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095120 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095438 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095664 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.095982 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.096077 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.096298 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.096392 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.096610 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.096704 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.096918 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097014 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097230 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097322 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097541 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097629 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097848 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.097992 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.098165 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.098310 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.098493 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.098637 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.098797 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.098930 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.099110 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.099250 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.099425 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.099561 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.099749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.099883 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.100059 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.100200 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.100369 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.100501 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.100688 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.100820 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101003 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101136 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101317 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101453 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101633 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101764 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.101951 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.102091 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.102268 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.102409 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.102605 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.102736 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.102920 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.103051 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.103240 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.103386 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.103548 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.103681 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.103871 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104007 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104141 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104300 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104440 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104574 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104737 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.104875 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105050 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105209 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105358 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105494 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105650 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.105958 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.106097 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.106264 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.106400 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.106593 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.106733 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.106919 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107058 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107230 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107364 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107534 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107669 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107841 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.107973 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.108143 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.108285 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.108473 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.108609 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.108780 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.108918 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.109085 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.109216 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.109395 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.109543 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.109703 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.109843 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.110050 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.110736 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.110919 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.111066 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.111240 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.111384 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.111555 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.111699 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.111872 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.112027 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.112189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.112327 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.112505 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.112636 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.112827 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113046 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113181 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113324 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113460 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113589 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113731 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.113861 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.114054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.114139 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.114365 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.114471 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.114712 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.114801 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115020 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115106 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115337 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115430 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115664 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115830 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.115982 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.116075 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.116306 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.116391 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.116614 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.116699 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.116933 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.117019 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.117251 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.117337 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.117565 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.117653 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.117880 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118021 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118194 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118295 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118532 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118625 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118857 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.118943 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.119170 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.119268 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.119489 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.119575 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.119805 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.119890 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.120122 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.120221 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.120433 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.120518 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.120751 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.120843 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.121057 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.121152 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.121374 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.121460 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.121700 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.121785 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122016 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122104 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122330 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122437 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122665 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122797 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.122985 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.123122 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.123318 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.123435 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.123655 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.123749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.123973 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.124059 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.124289 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.124381 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.124613 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.124699 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.124929 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.125016 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.125241 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.125326 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.125549 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.125646 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.126405 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.126592 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.126742 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.126840 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.127059 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.127161 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.127368 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.127454 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.127673 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.127759 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.128232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.128330 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.128541 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.128627 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.128861 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.128946 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.129173 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.129270 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.129481 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.129566 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.129789 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.129875 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.130101 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.130189 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.130407 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.130512 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.130754 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.130840 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131067 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131155 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131372 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131461 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131675 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131769 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.131983 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.132077 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.132312 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.132397 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.132620 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.132704 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.132925 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133015 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133276 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133376 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133542 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133629 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133847 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.133933 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.134161 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.134257 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.134491 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.134605 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.134803 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.134891 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.135127 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.135214 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.135438 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.135575 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.135744 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.135829 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136053 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136141 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136364 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136458 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136672 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136772 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.136983 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.137076 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.137293 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.137386 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.137603 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.137696 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.137913 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138000 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138223 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138317 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138551 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138652 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138865 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.138951 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.139182 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.139305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.139494 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.139755 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.139841 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.140088 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.140188 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.140403 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.140494 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.140722 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.140817 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.141043 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.141286 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.141393 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.141655 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.141741 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.141979 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.142074 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.142305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.142392 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.142661 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.142761 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.142971 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143065 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143277 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143364 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143584 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143682 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143897 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.143985 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.144203 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.144298 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.144507 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.144601 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.144814 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.144902 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.145125 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.145220 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.145430 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.145525 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.145735 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.145824 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146161 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146342 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146459 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146680 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146773 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.146983 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147085 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147289 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147373 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147590 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147676 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147896 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.147990 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.148211 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.148303 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.148517 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.148605 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.148817 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.148903 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.149124 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.149210 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.149448 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.149532 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.149761 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.149855 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.150069 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.150156 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.150378 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.150513 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.150713 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.150801 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.151060 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.151154 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.151367 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.151461 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.151691 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.151777 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152001 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152087 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152306 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152405 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152614 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152701 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.152926 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153236 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153331 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153542 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153628 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153856 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.153950 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.154161 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.154302 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.154495 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.154586 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.154810 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.154898 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.155116 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.155203 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.155426 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.155511 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.155733 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.155817 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156046 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156131 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156354 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156439 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156660 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156751 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.156965 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157070 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157299 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157387 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157606 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157692 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157912 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.157999 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.158218 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.158310 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.158542 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.158644 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.158863 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.158949 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.159170 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.159255 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.159477 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.159570 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.159785 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.159870 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.160091 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.160176 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.160399 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.160492 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.160703 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.160795 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161010 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161095 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161321 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161415 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161623 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161709 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.161926 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162020 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162231 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162315 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162554 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162645 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162860 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.162945 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.163171 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.163265 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.163475 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.163567 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.163789 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.163874 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164090 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164177 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164394 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164478 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164695 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164783 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.164998 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.165092 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.165302 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.165388 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.165611 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.165706 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.165915 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.166065 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.166199 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.166334 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.166529 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.166747 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.166884 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167029 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167162 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167293 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167438 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167578 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167719 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.167863 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168004 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168136 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168300 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168453 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168605 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168737 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.168924 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169060 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169225 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169360 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169530 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169681 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169839 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.169976 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.170151 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.170287 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.170499 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.170634 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.170809 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.170945 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.171121 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.171263 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.171436 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.171572 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.171741 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.171872 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.172055 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.172187 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.172366 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.172502 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.173188 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.173323 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.173498 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.173634 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.173802 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.173940 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.174118 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.174275 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.174472 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.174609 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.174745 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.174880 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.175065 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.175212 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.175372 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.175507 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.175696 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.175831 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176004 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176150 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176298 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176433 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176615 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.176927 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177077 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177237 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177373 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177546 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177688 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177857 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.177991 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.178167 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.178306 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.178500 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.178636 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.178815 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.178906 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.179127 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.179221 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.179432 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.179519 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.179743 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.179831 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180056 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180141 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180360 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180446 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180676 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180762 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.180983 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181068 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181287 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181386 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181594 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181681 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181898 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.181984 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.182211 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.182305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.182544 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.182636 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.182849 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.182970 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.183163 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.183287 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.183473 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.183599 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.183789 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.183903 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.184098 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.184199 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.184514 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.184607 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.184828 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.184912 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.185138 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.185225 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.185443 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.185529 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.185755 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.185860 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.186071 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.186157 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.186390 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.186539 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.186734 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.186820 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.187044 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.187140 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.187378 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.187464 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.187689 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.187783 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.188013 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.188100 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.188846 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.188982 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.189165 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.189262 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.189472 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.189558 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.189795 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.189881 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.190106 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.190201 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.190456 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.190548 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.190755 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.190870 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.191064 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.191187 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.191391 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.191497 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.191701 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.191916 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.192027 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.192229 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.192460 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.192554 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.192775 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.192861 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.193086 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.193181 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.193468 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.193553 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.193774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.193859 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.194090 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.194177 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.194400 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.194502 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.194744 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.194840 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195068 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195153 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195377 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195465 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195687 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195773 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.195993 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.196079 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.196318 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.196416 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.196639 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.196734 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.196953 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.197038 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.197271 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.197359 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.197580 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.197666 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.197906 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198006 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198231 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198317 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198573 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198675 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198900 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.198996 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.199240 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.199336 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.199548 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.199635 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.199862 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.199962 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.200175 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.200271 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.200483 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.200571 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.200807 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.200903 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.201114 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.201201 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.201428 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.201514 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.201733 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.201819 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.202041 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.202133 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.202347 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.202448 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.202677 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.202773 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203002 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203087 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203304 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203390 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203627 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203715 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.203958 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204045 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204271 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204364 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204597 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204685 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204903 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.204991 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.205225 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.205324 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.205534 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.205629 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.205839 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.205926 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.206143 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.206274 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.206470 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.206561 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.206798 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.206883 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.207108 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.207247 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.207414 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.207507 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.207723 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.207810 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208030 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208124 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208353 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208446 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208667 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208753 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.208990 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.209077 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.209303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.209391 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.209618 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.209704 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.209942 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210029 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210252 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210339 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210578 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210667 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210890 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.210987 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.211194 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.211281 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.211497 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.211583 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.211802 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.211897 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.212109 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.212208 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.212411 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.212510 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.212715 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.212801 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213020 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213118 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213329 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213424 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213629 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213715 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.213937 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214022 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214244 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214414 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214553 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214634 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214863 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.214949 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.215167 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.215271 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.215494 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.215580 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.215800 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.215888 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.216107 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.216203 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.216417 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.216503 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.216724 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.216810 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.217060 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.217155 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.217367 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.217452 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.217690 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.217777 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218009 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218095 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218324 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218439 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218666 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218752 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.218985 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.219071 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.219300 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.219386 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.219665 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.219765 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.219987 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.220075 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.220305 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.220400 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.220623 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.220717 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.220936 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.221022 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.221254 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.221340 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.221574 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.221764 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.221889 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.222096 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.222208 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.222451 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.222561 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.222758 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.222846 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.223075 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.223367 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.223455 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.223698 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.223830 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224013 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224100 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224329 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224416 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224643 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224739 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.224956 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.225043 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.225272 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.225356 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.225590 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.225678 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.225907 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226001 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226222 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226317 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226563 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226657 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226883 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.226970 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.227202 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.227297 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.227519 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.227606 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.227864 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.227950 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.228182 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.228268 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.228491 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.228579 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.228808 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.228903 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.229126 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.229214 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.229442 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.229538 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.229758 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.229854 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.230083 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.230169 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.230399 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.230509 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.230737 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.230838 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231052 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231146 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231365 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231453 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231680 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231778 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.231993 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.232080 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.232308 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.232393 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.232625 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.232720 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.232938 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233027 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233249 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233334 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233563 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233651 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233880 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.233966 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.234215 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.234394 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.234556 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.234742 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.234874 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.235624 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.235726 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.235980 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.236086 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.236313 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.236565 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.236710 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.236891 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.236991 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.237230 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.237318 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.237552 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.237638 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.237860 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.237955 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.238174 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.238268 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.238514 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.238617 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.238835 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.238932 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.239146 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.239232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.239457 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.239551 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.239760 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.239856 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.240078 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.240165 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.240388 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.240474 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.240714 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.240921 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.241016 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.241269 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.241357 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.241588 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.241683 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.241917 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.242004 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.242245 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.242480 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.242593 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.242840 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.242929 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.243167 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.243260 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.243503 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.243589 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.243807 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.243894 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.244125 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.244223 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.244438 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.244535 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.244745 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.244833 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245052 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245140 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245366 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245472 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245675 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245763 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.245982 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.246082 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.246290 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.246397 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.246616 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.246742 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.246936 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247022 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247242 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247340 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247552 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247640 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247860 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.247948 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.248165 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.248252 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.248469 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.248556 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.248777 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.248872 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.249084 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.249172 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.249388 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.249481 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.249703 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.249800 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.250008 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.250096 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.250317 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.250403 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.250650 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.250755 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.251016 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.251105 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.251811 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.251900 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.252122 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.252290 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.252435 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.252529 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.252746 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.253080 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.253316 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.253411 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.253626 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.253719 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.253939 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.254025 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.254248 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.254345 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.254596 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.254696 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.254913 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255000 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255226 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255364 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255549 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255635 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255867 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.255952 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.256197 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.256392 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.256512 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.256728 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.256849 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.257051 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.257147 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.257386 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.257480 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.257719 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.257989 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.258077 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.258322 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.258414 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.258652 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.258739 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.258978 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.259065 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.259291 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.259381 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.259601 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.259723 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.259913 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260007 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260223 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260310 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260534 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260619 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260842 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.260941 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.261153 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.261240 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.261465 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.261550 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.261773 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.261867 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.262087 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.262175 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.262394 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.262554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.262733 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.262820 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263043 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263128 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263356 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263441 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263671 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263760 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.263985 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.264071 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.264300 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.264385 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.264617 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.264704 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.264925 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265026 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265235 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265329 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265546 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265634 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265856 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.265949 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.266172 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.266272 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.266543 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.266636 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.266865 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.266997 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.267169 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.267263 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.267483 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.267570 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.267804 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.267897 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.268139 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.268235 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.268458 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.268545 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.268768 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.268862 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.269106 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.269200 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.269431 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.269525 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.269744 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.269831 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.270068 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.270224 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.270380 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.270482 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.270738 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.270838 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.271079 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.271167 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.271408 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.271495 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.271735 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.271829 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272040 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272126 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272345 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272432 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272651 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272749 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.272960 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273047 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273278 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273364 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273587 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273682 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273890 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.273977 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.274194 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.274288 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.274526 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.274618 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.274832 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.274931 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.275136 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.275223 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.275441 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.275572 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.275745 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.275831 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276052 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276147 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276355 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276450 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276659 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276752 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.276961 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277103 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277264 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277351 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277567 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277653 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277871 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.277967 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.278175 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.278269 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.278500 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.278590 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.278808 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.278909 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.279111 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.279205 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.279414 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.279513 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.279717 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.279817 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280025 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280114 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280336 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280422 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280645 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280732 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.280953 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.281041 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.281262 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.281348 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.281590 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.281678 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.281900 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.282547 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.282775 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.282862 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.283102 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.283191 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.283418 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.283505 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.283728 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.283813 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284051 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284137 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284361 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284443 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284674 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284780 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.284987 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.285075 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.285300 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.285387 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.285614 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.285709 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.285927 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286014 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286242 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286328 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286588 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286692 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286895 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.286981 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.287210 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.287304 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.287528 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.287624 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.287847 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.287933 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.288165 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.288253 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.288478 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.288565 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.288805 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.288891 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.289121 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.289218 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.289432 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.289522 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.289750 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.289843 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.290061 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.290148 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.290375 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.290487 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.290719 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.290818 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291033 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291128 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291355 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291449 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291670 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291758 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.291989 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.292086 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.292313 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.292401 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.292633 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.292721 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.292958 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.293054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.293288 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.293374 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.293615 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.293702 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.293934 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.294022 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.294249 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.294335 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.294585 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.294676 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:07:04.294950 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.295285 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.295609 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.295929 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.296241 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:07:04.296490 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:07:04.318517 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.321741 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_db.sqlalchemy.engines [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.381725 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.context [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2df521c-6c27-48b0-b2f1-a0a30efe8016(cell1) {{(pid=102726) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:07:04.385319 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.context [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2df521c-6c27-48b0-b2f1-a0a30efe8016(cell1) {{(pid=102727) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:07:04.386055 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:07:04.387652 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:07:04.388457 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:07:04.389617 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_concurrency.lockutils [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:07:04.390373 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:07:04.391244 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_concurrency.lockutils [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:07:04.392072 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_concurrency.lockutils [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:07:04.394006 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_concurrency.lockutils [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:07:04.401362 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.406393 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.409819 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_db.sqlalchemy.engines [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.413288 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_db.sqlalchemy.engines [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.562940 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.571078 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG oslo_db.sqlalchemy.engines [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:07:04.901812 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: WARNING keystonemiddleware.auth_token [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:07:04.904394 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: WARNING keystonemiddleware.auth_token [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:07:04.909765 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: WARNING keystonemiddleware.auth_token [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:07:04.912245 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: WARNING keystonemiddleware.auth_token [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:07:05.259608 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: WARNING keystonemiddleware.auth_token [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:07:05.266436 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: WARNING keystonemiddleware.auth_token [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:07:05.272784 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: WARNING keystonemiddleware.auth_token [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:07:05.273202 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561506f439c0 pid: 102726 (default app) May 12 17:07:05.275170 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:07:05.276349 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001834 May 12 17:07:05.277094 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Thu May 12 17:07:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:07:05.278948 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: WARNING keystonemiddleware.auth_token [None req-78f18480-8571-49da-888a-2c9fb59ce100 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:07:05.285117 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561506f439c0 pid: 102727 (default app) May 12 17:08:22.643518 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:22.644561 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 12 17:08:22.644952 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:23.060394 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-72c0d5db-ab2b-4aa9-b3b0-812bc64b2b7d admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:23.090083 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-72c0d5db-ab2b-4aa9-b3b0-812bc64b2b7d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.438286 May 12 17:08:23.090776 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 12 17:08:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:25.365843 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:25.367458 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-7bfb0cfd-3c00-45f2-acff-75d931bef022 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 May 12 17:08:25.368079 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:25.429907 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-fe8f285c-2ce9-40bb-bee5-de01bb97fa03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:25.448522 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:08:25.448522 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: warnings.warn(msg) May 12 17:08:25.476857 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-fe8f285c-2ce9-40bb-bee5-de01bb97fa03 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102547 May 12 17:08:25.477437 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:25.692863 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-2afc9edb-c3a7-4951-a38c-de2f2e2d9507 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:25.695334 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:08:25.695334 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: warnings.warn(msg) May 12 17:08:25.742859 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-2afc9edb-c3a7-4951-a38c-de2f2e2d9507 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.256806 May 12 17:08:25.743805 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 12 17:08:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:08:28.033789 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-fe8f285c-2ce9-40bb-bee5-de01bb97fa03 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:28.034860 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-fe8f285c-2ce9-40bb-bee5-de01bb97fa03 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 12 17:08:28.035265 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:28.136639 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-08e82e22-c145-446f-adaf-8d6c40d18ae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:28.154461 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:08:28.154461 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: warnings.warn(msg) May 12 17:08:28.171923 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-08e82e22-c145-446f-adaf-8d6c40d18ae4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130793 May 12 17:08:28.172668 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:28.184130 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-7f5b2d9b-46c7-4880-964b-5b10fe921151 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:28.185629 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:08:28.185629 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: warnings.warn(msg) May 12 17:08:28.219276 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-7f5b2d9b-46c7-4880-964b-5b10fe921151 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038707 May 12 17:08:28.219868 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 12 17:08:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:30.507664 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-08e82e22-c145-446f-adaf-8d6c40d18ae4 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:30.508717 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-08e82e22-c145-446f-adaf-8d6c40d18ae4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 12 17:08:30.509152 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:30.570801 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-adadee57-16d6-46e1-9074-47ca2c66b95a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:30.592271 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-adadee57-16d6-46e1-9074-47ca2c66b95a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076597 May 12 17:08:30.597114 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:30.605492 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-eefc56e4-c43d-4b20-b78d-e9f2014684ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:30.631098 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-eefc56e4-c43d-4b20-b78d-e9f2014684ff admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029433 May 12 17:08:30.635224 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 12 17:08:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:32.917909 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-adadee57-16d6-46e1-9074-47ca2c66b95a admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:32.919006 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-adadee57-16d6-46e1-9074-47ca2c66b95a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 12 17:08:32.919421 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:32.983138 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-9a03d5fa-5472-4206-a156-0544c6fb6ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:33.001239 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-9a03d5fa-5472-4206-a156-0544c6fb6ba6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075396 May 12 17:08:33.001829 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:33.013806 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-6e651ba3-4c65-40d4-8ebc-fda35b7551ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:33.036474 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-6e651ba3-4c65-40d4-8ebc-fda35b7551ac admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026302 May 12 17:08:33.037066 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 12 17:08:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:35.381235 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-9a03d5fa-5472-4206-a156-0544c6fb6ba6 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:35.382242 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-9a03d5fa-5472-4206-a156-0544c6fb6ba6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 12 17:08:35.382678 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:35.445218 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-7d742ab3-0293-412b-9329-0e0e101a47f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 4096, "id": "d4", "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:35.464254 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-7d742ab3-0293-412b-9329-0e0e101a47f1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075506 May 12 17:08:35.465445 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:08:35.476979 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-dbca89de-9957-412b-85b4-67aa477505a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:35.500002 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-dbca89de-9957-412b-85b4-67aa477505a6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026464 May 12 17:08:35.511776 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Thu May 12 17:08:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:37.748737 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-7d742ab3-0293-412b-9329-0e0e101a47f1 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:37.749802 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-7d742ab3-0293-412b-9329-0e0e101a47f1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 12 17:08:37.750218 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:37.811950 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-8b2bb984-3530-4340-a451-6e8a49c68c68 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:37.836146 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-8b2bb984-3530-4340-a451-6e8a49c68c68 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079496 May 12 17:08:37.836693 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 12 17:08:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:08:40.424083 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-7d742ab3-0293-412b-9329-0e0e101a47f1 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:40.425114 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-7d742ab3-0293-412b-9329-0e0e101a47f1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 12 17:08:40.425532 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:40.484661 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-0742cc75-308b-4388-b6ae-7234a01fa44c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:40.504868 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-0742cc75-308b-4388-b6ae-7234a01fa44c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073191 May 12 17:08:40.505525 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:40.517852 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d15f2f9f-0f10-4e3e-b146-9d1d16fabde8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:40.541027 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d15f2f9f-0f10-4e3e-b146-9d1d16fabde8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027402 May 12 17:08:40.541607 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 12 17:08:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:43.316687 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-0742cc75-308b-4388-b6ae-7234a01fa44c admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:43.317710 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-0742cc75-308b-4388-b6ae-7234a01fa44c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 12 17:08:43.318119 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:43.377205 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-a3e05afa-ad7a-4da3-a935-a2c123eb666b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:43.394491 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-a3e05afa-ad7a-4da3-a935-a2c123eb666b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070463 May 12 17:08:43.395060 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:43.408520 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-c41fa9e0-1699-42d2-943f-9342ccd9b369 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:43.435218 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-c41fa9e0-1699-42d2-943f-9342ccd9b369 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031110 May 12 17:08:43.435808 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 12 17:08:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:08:45.949505 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-a3e05afa-ad7a-4da3-a935-a2c123eb666b admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:45.950608 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-a3e05afa-ad7a-4da3-a935-a2c123eb666b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 12 17:08:45.951020 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:46.008697 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-b79f81dd-56db-4a4c-8f6f-dededbdc5d84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:46.027496 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-b79f81dd-56db-4a4c-8f6f-dededbdc5d84 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070732 May 12 17:08:46.028048 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:08:46.040028 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-0196301b-f6de-473e-be9f-9e8e6d51b8b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:46.063470 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-0196301b-f6de-473e-be9f-9e8e6d51b8b6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027010 May 12 17:08:46.064072 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 12 17:08:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:08:48.789316 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-b79f81dd-56db-4a4c-8f6f-dededbdc5d84 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:48.790937 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-b79f81dd-56db-4a4c-8f6f-dededbdc5d84 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002525 May 12 17:08:48.792459 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:48.862865 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-999b20e8-1d0a-4b02-88c4-34d622dfa1d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:48.898838 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-999b20e8-1d0a-4b02-88c4-34d622dfa1d5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.101209 May 12 17:08:48.899827 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:08:48.911471 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-47ca87fc-81de-4808-bbf3-23084985a1b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:48.941440 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-47ca87fc-81de-4808-bbf3-23084985a1b5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033968 May 12 17:08:48.942516 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 12 17:08:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:08:51.247683 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-999b20e8-1d0a-4b02-88c4-34d622dfa1d5 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:08:51.248730 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-999b20e8-1d0a-4b02-88c4-34d622dfa1d5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 12 17:08:51.249138 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:08:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:08:51.324346 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-72ab21c9-0976-4a1b-8b2d-ea42690688e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:51.345113 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-72ab21c9-0976-4a1b-8b2d-ea42690688e4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089736 May 12 17:08:51.345952 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Thu May 12 17:08:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:08:51.357494 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-ca525881-fb9f-4f3b-860c-c545380039d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:08:51.379871 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-ca525881-fb9f-4f3b-860c-c545380039d1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025938 May 12 17:08:51.380455 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Thu May 12 17:08:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:09:15.485402 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-72ab21c9-0976-4a1b-8b2d-ea42690688e4 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:15.486401 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-72ab21c9-0976-4a1b-8b2d-ea42690688e4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 12 17:09:15.486825 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:15.542615 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-5532e87d-1747-4f37-921f-0300ad153fae admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:15.559858 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-5532e87d-1747-4f37-921f-0300ad153fae admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067267 May 12 17:09:15.560384 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 12 17:09:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:16.552726 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-72ab21c9-0976-4a1b-8b2d-ea42690688e4 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:16.553724 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-72ab21c9-0976-4a1b-8b2d-ea42690688e4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 May 12 17:09:16.554150 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:16.755432 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-8016102a-807c-44e3-9c7e-29a50e448b21 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:16.761065 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.wsgi [None req-8016102a-807c-44e3-9c7e-29a50e448b21 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-8016102a-807c-44e3-9c7e-29a50e448b21 admin admin] Request method failure captured: May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Accept: application/json May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Accept-Encoding: gzip, deflate May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Connection: keep-alive May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Content-Length: 0 May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Host: 10.222.0.23 May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Openstack-Api-Version: compute 2.90 May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Openstack-System-Scope: None May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: User-Agent: python-novaclient May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Auth-Token: gAAAAABifT88vj1f7s63rKlLjPeA2OlNvCGgKlMGOFRA0XzNfhiGW-qJlCtV5lsSJ51vbnM_XHxDy2uRjP2NDddBAqTKEJRCgZUGWpgWluiyWFjZoaAIA2hdZU-t4hBwLsPF6A3bAQTzDLv6wttWurOhpOoPOZIXLPnwUoEJ5cGREEOPWkH8zPo May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Domain-Id: None May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Domain-Name: None May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Identity-Status: Confirmed May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Is-Admin-Project: True May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Domain-Id: default May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Domain-Name: Default May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Name: admin May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Role: member,reader,admin May 12 17:09:16.764793 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Roles: member,reader,admin May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_866d15d297214d9093f0667cd04e24ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant: admin May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant-Name: admin May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User: admin May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Domain-Id: default May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Domain-Name: Default May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Id: d93f79cb2be8486382d96c9dbca5fc55 May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Name: admin May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: method: > May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: exception: Flavor 42 could not be found. May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: action_args: {'id': '42'} May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:09:16.766407 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:16.767711 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:16.769111 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-8016102a-807c-44e3-9c7e-29a50e448b21 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:09:16.770483 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-8016102a-807c-44e3-9c7e-29a50e448b21 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060396 May 12 17:09:16.770483 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 12 17:09:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:09:16.775735 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-a2a1edf8-1e49-4818-a918-80a68eb5a38c admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:16.797634 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-a2a1edf8-1e49-4818-a918-80a68eb5a38c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025379 May 12 17:09:16.798160 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 12 17:09:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:16.815963 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-77b22217-3f2f-43a3-ac65-1147361f4e68 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:16.840149 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-77b22217-3f2f-43a3-ac65-1147361f4e68 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027669 May 12 17:09:16.840702 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 12 17:09:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:16.851575 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7a9dcb06-92d1-428e-9299-598c51f7761f admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:16.857153 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.wsgi [None req-7a9dcb06-92d1-428e-9299-598c51f7761f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7a9dcb06-92d1-428e-9299-598c51f7761f admin admin] Request method failure captured: May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Accept: application/json May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Accept-Encoding: gzip, deflate May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Connection: keep-alive May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Content-Length: 0 May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Host: 10.222.0.23 May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Openstack-Api-Version: compute 2.90 May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Openstack-System-Scope: None May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: User-Agent: python-novaclient May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Auth-Token: gAAAAABifT88vj1f7s63rKlLjPeA2OlNvCGgKlMGOFRA0XzNfhiGW-qJlCtV5lsSJ51vbnM_XHxDy2uRjP2NDddBAqTKEJRCgZUGWpgWluiyWFjZoaAIA2hdZU-t4hBwLsPF6A3bAQTzDLv6wttWurOhpOoPOZIXLPnwUoEJ5cGREEOPWkH8zPo May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Domain-Id: None May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Domain-Name: None May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Identity-Status: Confirmed May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Is-Admin-Project: True May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Domain-Id: default May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Domain-Name: Default May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Name: admin May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Role: member,reader,admin May 12 17:09:16.860749 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Roles: member,reader,admin May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_866d15d297214d9093f0667cd04e24ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant: admin May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant-Name: admin May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User: admin May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Domain-Id: default May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Domain-Name: Default May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Id: d93f79cb2be8486382d96c9dbca5fc55 May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Name: admin May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: method: > May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: exception: Flavor 42 could not be found. May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: action_args: {'id': '42'} May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:09:16.862293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:16.863232 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:16.864295 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7a9dcb06-92d1-428e-9299-598c51f7761f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:09:16.865341 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-7a9dcb06-92d1-428e-9299-598c51f7761f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014846 May 12 17:09:16.865341 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 12 17:09:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 17:09:17.740515 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-77b22217-3f2f-43a3-ac65-1147361f4e68 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:17.741540 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-77b22217-3f2f-43a3-ac65-1147361f4e68 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 12 17:09:17.741943 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:17.928605 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-8ede8c65-ce00-4539-9613-8877d7ab6e23 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:17.933744 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.wsgi [None req-8ede8c65-ce00-4539-9613-8877d7ab6e23 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-8ede8c65-ce00-4539-9613-8877d7ab6e23 admin admin] Request method failure captured: May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Accept: application/json May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Accept-Encoding: gzip, deflate May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Connection: keep-alive May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Content-Length: 0 May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Host: 10.222.0.23 May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Openstack-Api-Version: compute 2.90 May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Openstack-System-Scope: None May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: User-Agent: python-novaclient May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Auth-Token: gAAAAABifT89eVkNhT4FfPrkoICLs6xTduNb-CAeqrD6IvzD4yM7N0O_bGgZM5-NY1CuYJppubXpzWl8jHIL9-5GMunwijWcPM8r_FhKiStUfYEm5C8d6RMItL95Xc3ELGVuJHT8IhDHxTgTIXykwGyplAFALn0_VqfqHa2pthI1p90_yXYK0G8 May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Domain-Id: None May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Domain-Name: None May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Identity-Status: Confirmed May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Is-Admin-Project: True May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Domain-Id: default May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Domain-Name: Default May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Name: admin May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Role: member,reader,admin May 12 17:09:17.936501 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Roles: member,reader,admin May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_866d15d297214d9093f0667cd04e24ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant: admin May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant-Name: admin May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User: admin May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Domain-Id: default May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Domain-Name: Default May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Id: d93f79cb2be8486382d96c9dbca5fc55 May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Name: admin May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: method: > May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: exception: Flavor 84 could not be found. May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: action_args: {'id': '84'} May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:09:17.938063 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:17.939265 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:17.940619 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-8ede8c65-ce00-4539-9613-8877d7ab6e23 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:09:17.942045 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-8ede8c65-ce00-4539-9613-8877d7ab6e23 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059680 May 12 17:09:17.942045 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 12 17:09:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:09:17.949378 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-dc13e694-9b28-4171-9a52-0bf6293285e1 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:17.963233 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-dc13e694-9b28-4171-9a52-0bf6293285e1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017466 May 12 17:09:17.963801 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 12 17:09:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:17.972776 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-f69e79f6-2a2a-4e8f-beaf-3955b6807ee3 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:17.986477 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-f69e79f6-2a2a-4e8f-beaf-3955b6807ee3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017005 May 12 17:09:17.987042 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 12 17:09:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:17.996354 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-f610b24f-05dc-4af7-9c38-15c18c6d2e8a admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:18.002017 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.wsgi [None req-f610b24f-05dc-4af7-9c38-15c18c6d2e8a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-f610b24f-05dc-4af7-9c38-15c18c6d2e8a admin admin] Request method failure captured: May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Accept: application/json May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Accept-Encoding: gzip, deflate May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Connection: keep-alive May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Content-Length: 0 May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Host: 10.222.0.23 May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Openstack-Api-Version: compute 2.90 May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Openstack-System-Scope: None May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: User-Agent: python-novaclient May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Auth-Token: gAAAAABifT89eVkNhT4FfPrkoICLs6xTduNb-CAeqrD6IvzD4yM7N0O_bGgZM5-NY1CuYJppubXpzWl8jHIL9-5GMunwijWcPM8r_FhKiStUfYEm5C8d6RMItL95Xc3ELGVuJHT8IhDHxTgTIXykwGyplAFALn0_VqfqHa2pthI1p90_yXYK0G8 May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Domain-Id: None May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Domain-Name: None May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Identity-Status: Confirmed May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Is-Admin-Project: True May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Domain-Id: default May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Domain-Name: Default May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Name: admin May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Role: member,reader,admin May 12 17:09:18.003554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Roles: member,reader,admin May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_866d15d297214d9093f0667cd04e24ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant: admin May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant-Name: admin May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User: admin May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Domain-Id: default May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Domain-Name: Default May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Id: d93f79cb2be8486382d96c9dbca5fc55 May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Name: admin May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: method: > May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: exception: Flavor 84 could not be found. May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: action_args: {'id': '84'} May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:09:18.005352 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:18.006305 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:18.007758 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-f610b24f-05dc-4af7-9c38-15c18c6d2e8a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:09:18.009032 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-f610b24f-05dc-4af7-9c38-15c18c6d2e8a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012265 May 12 17:09:18.009032 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Thu May 12 17:09:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 17:09:18.890994 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-f69e79f6-2a2a-4e8f-beaf-3955b6807ee3 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:18.892006 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-f69e79f6-2a2a-4e8f-beaf-3955b6807ee3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 12 17:09:18.892402 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:19.083742 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-756f7562-80a4-4a91-9c2e-2ce713f5c0f6 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:19.095013 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.wsgi [None req-756f7562-80a4-4a91-9c2e-2ce713f5c0f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-756f7562-80a4-4a91-9c2e-2ce713f5c0f6 admin admin] Request method failure captured: May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Accept: application/json May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Accept-Encoding: gzip, deflate May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Connection: keep-alive May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Content-Length: 0 May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Host: 10.222.0.23 May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Openstack-Api-Version: compute 2.90 May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Openstack-System-Scope: None May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: User-Agent: python-novaclient May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Auth-Token: gAAAAABifT8-7jPC23cmxABZWVDCkyZx2rx6d5qbSPXRaVWXUNqkC30URqnU8iyhP25eovFYQKNdLr_0yi0Mu5a1d1xhv6jDmM6OLLoeJ2s4EmIUdAIK5kgXjiQ0OXLjj1sLaW2Bk1sjOoIjXoVjAeD4mMGmrFFy9jl_ZIOXZKx-Ag_pMrM0qoo May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Domain-Id: None May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Domain-Name: None May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Identity-Status: Confirmed May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Is-Admin-Project: True May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Domain-Id: default May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Domain-Name: Default May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Project-Name: admin May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Role: member,reader,admin May 12 17:09:19.096536 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Roles: member,reader,admin May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_866d15d297214d9093f0667cd04e24ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant: admin May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-Tenant-Name: admin May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User: admin May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Domain-Id: default May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Domain-Name: Default May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Id: d93f79cb2be8486382d96c9dbca5fc55 May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: X-User-Name: admin May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: method: > May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: exception: Flavor 451 could not be found. May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: action_args: {'id': '451'} May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:09:19.098054 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:19.099005 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: ERROR nova.api.openstack.wsgi May 12 17:09:19.100179 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-756f7562-80a4-4a91-9c2e-2ce713f5c0f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:09:19.101260 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-756f7562-80a4-4a91-9c2e-2ce713f5c0f6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069892 May 12 17:09:19.101260 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 12 17:09:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:09:19.107793 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-cb4c07f3-81e0-47d7-b72f-fc68fb838806 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:19.121083 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-cb4c07f3-81e0-47d7-b72f-fc68fb838806 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016922 May 12 17:09:19.121596 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 12 17:09:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:19.130980 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:19.144799 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017594 May 12 17:09:19.145316 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Thu May 12 17:09:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:09:19.154051 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7955398f-c489-4992-9394-7649976ad490 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:19.159716 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.wsgi [None req-7955398f-c489-4992-9394-7649976ad490 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7955398f-c489-4992-9394-7649976ad490 admin admin] Request method failure captured: May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Accept: application/json May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Accept-Encoding: gzip, deflate May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Connection: keep-alive May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Content-Length: 0 May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Host: 10.222.0.23 May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Openstack-Api-Version: compute 2.90 May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Openstack-System-Scope: None May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: User-Agent: python-novaclient May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Auth-Token: gAAAAABifT8-7jPC23cmxABZWVDCkyZx2rx6d5qbSPXRaVWXUNqkC30URqnU8iyhP25eovFYQKNdLr_0yi0Mu5a1d1xhv6jDmM6OLLoeJ2s4EmIUdAIK5kgXjiQ0OXLjj1sLaW2Bk1sjOoIjXoVjAeD4mMGmrFFy9jl_ZIOXZKx-Ag_pMrM0qoo May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Domain-Id: None May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Domain-Name: None May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Identity-Status: Confirmed May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Is-Admin-Project: True May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Domain-Id: default May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Domain-Name: Default May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Project-Name: admin May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Role: member,reader,admin May 12 17:09:19.161189 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Roles: member,reader,admin May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_866d15d297214d9093f0667cd04e24ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/866d15d297214d9093f0667cd04e24ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant: admin May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant-Id: 866d15d297214d9093f0667cd04e24ed May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-Tenant-Name: admin May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User: admin May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Domain-Id: default May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Domain-Name: Default May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Id: d93f79cb2be8486382d96c9dbca5fc55 May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: X-User-Name: admin May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: method: > May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: exception: Flavor 451 could not be found. May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: action_args: {'id': '451'} May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:09:19.162774 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:19.163894 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: ERROR nova.api.openstack.wsgi May 12 17:09:19.165303 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-7955398f-c489-4992-9394-7649976ad490 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:09:19.166574 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-7955398f-c489-4992-9394-7649976ad490 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011865 May 12 17:09:19.166574 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 12 17:09:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:09:20.046515 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:20.047535 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 12 17:09:20.047954 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:20.239425 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-1b60b56b-c346-43d7-b454-9614c8b8948b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:09:20.256601 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-1b60b56b-c346-43d7-b454-9614c8b8948b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067680 May 12 17:09:20.257126 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 12 17:09:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:09:21.153133 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:21.154238 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 May 12 17:09:21.155319 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:21.340502 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-91b56490-3ffc-4134-b546-0c5bd47e1899 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:09:21.357396 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-91b56490-3ffc-4134-b546-0c5bd47e1899 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067006 May 12 17:09:21.357937 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 12 17:09:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:09:22.239259 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:22.240267 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 12 17:09:22.240673 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:22.428981 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-669b3555-b060-446e-89fe-2202b32a375c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:09:22.445756 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-669b3555-b060-446e-89fe-2202b32a375c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068119 May 12 17:09:22.446291 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 12 17:09:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:09:23.333554 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:23.334625 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 12 17:09:23.335072 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:23.521469 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-46b123cc-85f5-41d1-a78c-68177e91e6d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:09:23.538670 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-46b123cc-85f5-41d1-a78c-68177e91e6d9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067368 May 12 17:09:23.539217 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Thu May 12 17:09:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:09:24.429537 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:24.430954 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 May 12 17:09:24.431411 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:09:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:09:24.618326 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-d32be117-1312-499b-92a2-92997e6ca64e admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:09:24.637949 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-d32be117-1312-499b-92a2-92997e6ca64e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069750 May 12 17:09:24.638435 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Thu May 12 17:09:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:10:26.142521 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:10:26.143439 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-d134a3c7-bdb4-4550-bba2-f52ce3f9e092 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 12 17:10:26.143850 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Thu May 12 17:10:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:10:26.199790 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-d8773dcc-0584-479a-bc90-d4683da1ad51 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:10:26.219577 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-d8773dcc-0584-479a-bc90-d4683da1ad51 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069741 May 12 17:10:26.220113 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Thu May 12 17:10:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:10:26.241691 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-69a0fe81-d37e-4d63-ace5-06e95f8ee9b7 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:10:26.249135 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-69a0fe81-d37e-4d63-ace5-06e95f8ee9b7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011562 May 12 17:10:26.249654 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Thu May 12 17:10:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:10:26.260606 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-48c169f4-42c1-4a04-ad5f-f4b62f9754ae admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:10:26.268598 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-48c169f4-42c1-4a04-ad5f-f4b62f9754ae admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011423 May 12 17:10:26.269158 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Thu May 12 17:10:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:10:26.280615 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:10:26.288101 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011508 May 12 17:10:26.288639 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Thu May 12 17:10:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:10:26.299843 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-673905de-3ad3-49c9-af6c-07e510ec5028 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:10:26.307304 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-673905de-3ad3-49c9-af6c-07e510ec5028 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011046 May 12 17:10:26.307813 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Thu May 12 17:10:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:13:52.607101 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:13:52.608123 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 12 17:13:52.608528 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:13:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:13:52.883003 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-6e6ab399-487d-470d-8edf-870cb55ffe21 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:13:52.884357 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:13:52.884357 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: warnings.warn(msg) May 12 17:13:52.885350 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-6e6ab399-487d-470d-8edf-870cb55ffe21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:13:52.885792 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-6e6ab399-487d-470d-8edf-870cb55ffe21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:13:52.887107 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-6e6ab399-487d-470d-8edf-870cb55ffe21 admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:13:52.887538 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-6e6ab399-487d-470d-8edf-870cb55ffe21 admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:13:52.920270 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-6e6ab399-487d-470d-8edf-870cb55ffe21 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155951 May 12 17:13:52.920836 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 12 17:13:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:13:53.825109 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:13:53.826124 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 12 17:13:53.826567 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:13:54.015457 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-d7007427-86e2-437f-8a5c-5f26553fc168 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:13:54.016650 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:13:54.016650 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: warnings.warn(msg) May 12 17:13:54.017822 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-d7007427-86e2-437f-8a5c-5f26553fc168 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:13:54.018260 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-d7007427-86e2-437f-8a5c-5f26553fc168 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:13:54.019076 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-d7007427-86e2-437f-8a5c-5f26553fc168 admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:13:54.019503 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-d7007427-86e2-437f-8a5c-5f26553fc168 admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:13:54.038293 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-d7007427-86e2-437f-8a5c-5f26553fc168 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.072958 May 12 17:13:54.038860 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 12 17:13:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:14:05.344574 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:14:05.345591 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 12 17:14:05.345994 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:14:05.532539 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-31fca58f-86da-41d5-aad7-51ea0a1d5db9 admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:14:05.533718 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:14:05.533718 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: warnings.warn(msg) May 12 17:14:05.534929 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-31fca58f-86da-41d5-aad7-51ea0a1d5db9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:14:05.535368 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-31fca58f-86da-41d5-aad7-51ea0a1d5db9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:14:05.536145 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-31fca58f-86da-41d5-aad7-51ea0a1d5db9 admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:14:05.536571 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-31fca58f-86da-41d5-aad7-51ea0a1d5db9 admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:14:05.561153 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-31fca58f-86da-41d5-aad7-51ea0a1d5db9 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078735 May 12 17:14:05.561627 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 12 17:14:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:14:06.456650 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: DEBUG nova.api.openstack.wsgi [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] Calling method '>' {{(pid=102727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:14:06.457655 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: INFO nova.api.openstack.requestlog [None req-045f5dfd-270a-40e2-a2c0-96e94681d981 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 12 17:14:06.458056 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: [pid: 102727|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Thu May 12 17:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:14:06.644112 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG nova.api.openstack.wsgi [None req-a16a96cf-5370-4130-af7b-e585afa956dd admin admin] Calling method '>' {{(pid=102726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:14:06.645263 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:14:06.645263 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: warnings.warn(msg) May 12 17:14:06.646457 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-a16a96cf-5370-4130-af7b-e585afa956dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:14:06.646904 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-a16a96cf-5370-4130-af7b-e585afa956dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:14:06.647710 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-a16a96cf-5370-4130-af7b-e585afa956dd admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:14:06.648146 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: DEBUG oslo_concurrency.lockutils [None req-a16a96cf-5370-4130-af7b-e585afa956dd admin admin] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:14:06.670641 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: INFO nova.api.openstack.requestlog [None req-a16a96cf-5370-4130-af7b-e585afa956dd admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076559 May 12 17:14:06.671187 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: [pid: 102726|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Thu May 12 17:14:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:15:08.000274 dv-cinder-841591-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 17:15:08.000827 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: Thu May 12 17:15:08 2022 - graceful shutdown triggered... May 12 17:15:08.001280 dv-cinder-841591-1-iscsi devstack@n-api.service[102726]: Gracefully killing worker 1 (pid: 102726)... May 12 17:15:08.003689 dv-cinder-841591-1-iscsi devstack@n-api.service[102727]: Gracefully killing worker 2 (pid: 102727)... May 12 17:15:09.001107 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: worker 1 buried after 1 seconds May 12 17:15:09.001542 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: worker 2 buried after 1 seconds May 12 17:15:09.001542 dv-cinder-841591-1-iscsi devstack@n-api.service[102725]: goodbye to uWSGI. May 12 17:15:09.002736 dv-cinder-841591-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 17:15:09.003308 dv-cinder-841591-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 17:15:09.006016 dv-cinder-841591-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 17:15:09.021180 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:15:09 2022] *** May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: nodename: dv-cinder-841591-1-iscsi May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: machine: x86_64 May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: clock source: unix May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: pcre jit disabled May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: detected number of CPU cores: 4 May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: current working directory: / May 12 17:15:09.034221 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: detected binary path: /usr/bin/uwsgi-core May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: your processes number limit is 47680 May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: your memory page size is 4096 bytes May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: detected max file descriptor number: 2048 May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: lock engine: pthread robust mutexes May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: thunder lock: enabled May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 17:15:09.035007 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:15:09.080199 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: Python main interpreter initialized at 0x55c85bc879c0 May 12 17:15:09.080199 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: python threads support enabled May 12 17:15:09.080199 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: your server socket listen backlog is limited to 100 connections May 12 17:15:09.080199 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: your mercy for graceful operations on workers is 90 seconds May 12 17:15:09.080681 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:15:09.080681 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: *** Operational MODE: preforking *** May 12 17:15:09.080911 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: *** uWSGI is running in multiple interpreter mode *** May 12 17:15:09.080911 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: spawned uWSGI master process (pid: 117064) May 12 17:15:09.081117 dv-cinder-841591-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 17:15:09.081700 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: spawned uWSGI worker 1 (pid: 117074, cores: 1) May 12 17:15:09.082456 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: spawned uWSGI worker 2 (pid: 117075, cores: 1) May 12 17:15:09.082456 dv-cinder-841591-1-iscsi devstack@n-api.service[117064]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:15:10.283655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:15:10.289695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:15:11.085462 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:15:11.085462 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: from cryptography.utils import int_from_bytes May 12 17:15:11.085778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:15:11.085778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: from cryptography.utils import int_from_bytes May 12 17:15:11.089843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:15:11.089843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: from cryptography.utils import int_from_bytes May 12 17:15:11.090169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:15:11.090169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: from cryptography.utils import int_from_bytes May 12 17:15:13.520632 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:15:13.521184 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:15:13.521458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:15:13.521778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:15:13.522036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:15:13.522442 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.522783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.523103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.523419 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.523745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.524051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.524386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.524696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.525022 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.525284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.525599 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.525926 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-1-iscsi {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.526245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.526576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.526889 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.527206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.527512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.527834 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.528141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.528637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.530730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.530730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.530730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.530730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.531081 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.531296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.531524 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.531842 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.532162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.532474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.532873 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-1-iscsi {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.533218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.533512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.533823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.534238 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.534574 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.534903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.535208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.535528 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.535837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.536158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.536479 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.536794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.537112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.537429 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.537722 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.538031 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.538352 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.538685 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.538991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.539239 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.539545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.539864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.540185 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.540508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.540759 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.541015 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.541332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.541651 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.541959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.542263 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.542596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.542903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.543221 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.543515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.543819 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.544123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.544443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.544869 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.545083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.545397 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.545715 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.546110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.546359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.546696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.547032 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.547349 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.547660 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.547979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.548295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.548604 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.548910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.549219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.549535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.549857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.550163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.550413 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.550735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.551045 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.551361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.551666 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.552008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.552271 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.552583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.552877 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.553178 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.553495 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.553786 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.554086 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.554390 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.554580 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:15:13.555049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:15:13.555206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.555206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.555520 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:15:13.555666 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.555828 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:15:13.555988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.556141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:15:13.556293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.556489 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.556643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.556819 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.557190 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.557190 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.557481 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.557636 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.557789 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.557931 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.558072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.558221 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.558369 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.558595 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.558813 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.559002 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.559154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.559398 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.559559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.559709 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.559862 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-1-iscsi {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.560908 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.561058 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.561253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.561418 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.561562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.561715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.561864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.562007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.562276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.562463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.562630 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.562785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.563034 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.563034 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.563331 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.563512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.563723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.563955 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.564105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.564248 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.564399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.564583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.564731 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.564883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.565026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.565181 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.565334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.565486 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.565641 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.565810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566152 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566315 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566476 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.566968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.567543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-1-iscsi {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.567696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.567846 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.567846 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.568132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.568132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.568427 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.568612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.568763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.568992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.569148 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.569359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.569575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.569734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.569892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.570035 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.570187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.570337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.570513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.570672 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.570817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.570965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.571122 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.571273 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.571437 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.571580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.571732 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.571961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.572105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.572271 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.572483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.572673 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.572829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.572987 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.573226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.573383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.573544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.573703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.573937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.574161 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.574310 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.574478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.574628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.574770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.574922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.575113 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.575262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.575414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.575564 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.575564 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.575866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.576020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.576165 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.576315 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.576468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.576610 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.576765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.576916 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.577068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.577239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.577667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.577830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.577976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.578117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.578259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.578410 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.578581 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.578736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.578886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.579117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.579789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.580006 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.580153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.580322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.580476 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.580627 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.580776 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.580920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.581069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.581228 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.581381 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.581530 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.581673 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.581815 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.581961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.582112 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.582270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.582414 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.582702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.582856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.583014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.583163 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.583426 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.583570 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.583712 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.583854 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.584283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.584436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.584588 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.584743 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.584891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.584891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.585188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.585330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.585472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.585619 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.585819 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.585968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.586125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.586277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.586444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.586444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.586742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.586896 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.587045 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.587195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.587344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.587511 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.587915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.588076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.588227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.588378 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.588531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.588719 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.588880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.589033 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.589266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.589416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.589564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.589707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.589847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.590021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.590244 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.590400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.590734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.590897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.591049 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.591246 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.591403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.591548 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.591770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.592435 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.592597 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.592820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.592988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.592988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.593276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.593505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.593660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.593818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.593981 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.594124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.594408 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.594587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.594732 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.594895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.595039 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.595181 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.595343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.595343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.595623 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.595765 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.595914 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.595914 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.596218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.596218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.596503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.596652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.596794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.596942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.597100 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.597252 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.597395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.597544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.597694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.598112 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.598285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.598465 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.598614 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.598614 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.599039 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.599216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.599457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.599614 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.599765 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.599915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.600057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.600227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.600461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.600610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.600761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.600910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.601061 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.601282 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.601436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.601579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.601767 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.601924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.602068 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.602219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.602363 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.602556 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.602712 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.602938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.603105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.603260 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.603412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.603637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.603794 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.603948 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.604106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.604249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.604541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:15:13.604701 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.604903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.605056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.605209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.605353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.605504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.605654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.605795 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.606023 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.606187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.606332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.606504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.606699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.606866 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.607024 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.607336 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.607489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.607632 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.607774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.607944 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.608286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.608522 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.608679 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.608830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.608982 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.609132 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.609296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.609464 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.609691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.609842 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.609991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.610134 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.610284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.610480 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.610705 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.610853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611163 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611458 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611908 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.611908 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.612194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.612344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.612486 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.612634 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.613384 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.613559 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.613804 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.613964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.614126 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.614269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.614443 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.614760 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.614913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.615929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616081 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616231 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616538 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616839 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.616983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.617131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.617284 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.617434 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.617587 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.617730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.617918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.618085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.618483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.618849 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.618995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619583 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.619785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.620227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.620388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.620388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.620710 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.620961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.621125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.621328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.621499 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.621733 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.621900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.622051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.622208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.622366 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.622552 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.622704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.622865 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.623202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.623396 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.623565 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.623716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.623959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.624117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.624278 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.624427 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.624590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.624899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625066 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625217 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625378 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625536 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625701 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625701 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.625995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.626144 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.626293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.626483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.626659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.626810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.626975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.627124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.627284 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.627445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.627603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.627771 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.627928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.628095 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.628246 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.628580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.628869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629035 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629352 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629501 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629671 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.629987 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.630137 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.630293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.630470 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.630641 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.630793 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.630960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.631181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.631344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.631495 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.631495 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.632070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.632229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.632386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.632536 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.632707 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.632866 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.633027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.633326 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.633495 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.633648 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.633879 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.634174 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.634346 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.634346 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.634681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635178 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635781 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.635941 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.636093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.636251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.636487 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.636754 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.637074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.637355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.637629 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.637885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.638077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.638233 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.638383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.639333 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.639533 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.639695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.639847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640011 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640187 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640350 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640817 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.640968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641073 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641442 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641720 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.641978 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.642107 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.642235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.642372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.642536 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.642667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.642847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.643072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.643534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.643821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.644080 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.644421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.644642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.644642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.645338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.645503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.645636 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.645774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.646192 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.646326 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.646533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.646676 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.646823 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.646960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647096 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647231 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647362 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647637 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.647892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648167 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648570 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648843 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.648980 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.649131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.649532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.649667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.649795 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.649922 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.650098 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.650236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.650372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.650516 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.650656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.650925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651573 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651573 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.651829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.652325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.652460 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.652460 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.652460 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.652460 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.652960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.653095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.653230 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.653368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.653368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.653783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.653923 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.654052 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.654235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.654894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.655111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.655111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.655503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.655631 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.655769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.655911 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656167 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656167 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656421 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656693 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.656830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657095 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657232 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657232 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657493 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657622 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657757 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.657885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658140 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658269 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658269 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658544 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658672 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.658939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.659188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.659340 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.659707 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.659849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.659849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660391 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.660967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.661227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.661356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.661356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.661693 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.661835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.661964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662093 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662093 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662491 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662633 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.662763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.663945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664830 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664966 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.664966 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.665325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.665601 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.665745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.665874 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.665874 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.666131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.666260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.666502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.666646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.666646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.666899 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667070 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667070 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667326 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667471 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667608 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.667980 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668121 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668527 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.668904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.669078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.669208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.669335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.669335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.669886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670032 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670297 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670297 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670720 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670986 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.670986 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.671236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.671367 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.671367 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.671632 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.671834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672165 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672165 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672389 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.672840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673052 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673288 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673407 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673407 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673630 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673765 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.673966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.674158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.675072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.675072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.675072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.675072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.675072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.675072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676290 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676419 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676557 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.676957 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.677284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.677415 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.677845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.677989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.678336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.678492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.678850 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.678999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.679320 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.679453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.679782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.680111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.680245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.680387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.680526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.680751 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.680890 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.681119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.681249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.681447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.681715 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.681874 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.682127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.682259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.682396 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.682667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.682819 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.683131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.683526 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.688332 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.688533 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690244 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690693 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.690968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.691100 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.691229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.691357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.691487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.691616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.692352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.692516 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.692649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.692789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.692789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.693054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.693194 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.695844 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696024 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696319 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696450 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696598 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.696906 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697328 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697328 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697713 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.697871 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698693 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.698953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699607 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699607 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699872 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.699872 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.701734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.701994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.701994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.702233 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.702411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.702948 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.703142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.703142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.703408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.703408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.704293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.704293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.704607 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.704793 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.704917 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.705044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.705197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.705376 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.705792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.705933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.705933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.706198 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.706509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.706509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.706792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.706984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.706984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.707224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.707335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.707460 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.707626 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.707626 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708001 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708107 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708107 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708265 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708727 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.708944 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709338 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709604 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709780 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.709898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.710312 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.710474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.710599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.710599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.710903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.711412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.711552 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.711678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.711790 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.711901 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712130 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712130 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712679 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712809 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.712972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.713495 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.713628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.713756 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.713892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714265 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714551 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714733 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714831 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.714925 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715289 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.715916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716149 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716375 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716375 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.716788 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717703 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717797 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717882 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.717972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718350 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718576 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.718984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719074 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719159 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719241 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719510 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719601 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719687 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719771 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.719952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720212 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720401 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720662 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720758 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.720940 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721690 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721825 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.721962 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722051 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722466 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722598 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722725 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.722942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723223 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.723888 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724287 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724641 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.724968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.725211 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.725354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.725503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.725604 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.725810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.725952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.726117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.726237 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.726471 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.726789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.727101 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.727263 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.727410 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.727603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.727778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728004 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728157 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728317 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728644 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.728960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.729105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.729279 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.729430 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.729574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.729732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.729975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.730122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.730267 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.730410 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.730585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.730740 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.730898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.731048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.731199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.731356 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.731500 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.731750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.731903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732058 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732202 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732749 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.732947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733330 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.733968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.734061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.734333 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.734524 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.734691 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.734965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.735077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.735298 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.735483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.735606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.735708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.735924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736016 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736520 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736677 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.736937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.737159 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.737273 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.737463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.737626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.737778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.737903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.738096 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.738225 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.738444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.738541 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.738761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.738868 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.739097 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.739241 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.739427 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.739523 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.739745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.739845 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740380 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740478 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740691 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.740984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.741093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.741297 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.741397 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.741603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.741725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.741914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742019 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742322 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742875 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.742977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.743178 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.743279 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.743481 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.743578 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.743801 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.743901 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.744103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.744196 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.744439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.744574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.744729 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.744907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745035 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745127 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745341 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745644 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745736 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.745987 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.746080 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.746292 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.746386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.746631 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.746734 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.746952 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.747054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.747279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.747477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.747612 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.747796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.747950 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.748159 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.748277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.748489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.748583 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.748816 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.748917 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.749140 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.749233 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.749458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.749559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.749788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.749889 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.750101 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.750195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.750408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.750534 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.750742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.750843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751151 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751362 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751464 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751682 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.751994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.752241 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.752341 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.752572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.752665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.752891 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.753000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.753209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.753433 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.753527 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.753793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.753899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.754117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.754218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.754668 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.754778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.754885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755013 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755144 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755362 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755498 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755692 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.755822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.756023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.756344 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.756937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.757101 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.757258 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.757404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.757549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.757700 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.757916 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.758083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.758228 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.758379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.758554 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.758700 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.758859 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.759021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.759174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.759324 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.759581 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.759905 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.760215 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.760529 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.760659 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.760847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.760983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.761158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.761260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.761466 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.761557 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.761782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.761874 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.762091 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.762193 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.762398 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.762522 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.762858 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.762996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.763118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.763240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.764058 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.764195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.764317 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.764437 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.764576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.764929 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765207 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765290 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765453 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765547 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.765857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.766122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.766215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.766470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.766680 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.766810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.766999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.767116 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.767335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.767452 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.767663 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.767767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.767991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.768106 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.768303 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.768406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.768619 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.768728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.768948 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.769075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.769258 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.769365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.769562 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.769802 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.769920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.770142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.770252 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.770486 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.770582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.770860 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.770962 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.771127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.771232 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.771433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.771542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.771759 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.771929 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.772095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.772255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.772396 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.772586 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.772738 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.772938 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773255 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773351 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773582 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.773995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.774214 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.774330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.774548 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.774718 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.774976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775122 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775456 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.775870 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776381 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776787 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.776998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.777141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.777308 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.777401 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.777609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.777710 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.777919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778019 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778221 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778329 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778577 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778888 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.778977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.779242 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.779853 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780048 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780450 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780665 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780803 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.780983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.781084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.781330 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.781422 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.781639 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.781741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.781951 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.782057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.782254 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.782400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.782593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.782689 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.782898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783211 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.783916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.784178 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.784285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.784504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.784610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.784805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.784907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.785107 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.785243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.785420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.785512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.785731 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.785834 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.786059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.786202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.786361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.786490 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.786703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.786839 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.787102 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.787425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.787757 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.787958 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.788077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.788293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.788434 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.788616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.788744 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.789045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.789243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.789393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.789557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.789708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.789855 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.790004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.790152 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.790298 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.790543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.790705 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.790867 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791703 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.791999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.792146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.792303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.792461 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.792608 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.792756 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.792903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793414 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.793917 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.794065 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.794198 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.794362 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.794549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.794765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.794935 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.795077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.795214 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.795397 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.795508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.795709 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.795850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796024 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796639 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.796950 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.797041 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.797260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.797361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.797578 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.797709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.797906 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798323 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.798963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.799175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.799272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.799489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.799585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.799802 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.799905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.800131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.800225 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.800458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.800553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.800765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.800871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.801092 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.801201 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.801409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.801502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.801724 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.801826 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.802041 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.802133 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.802355 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.802489 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.802727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.802994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.803152 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.803293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.803437 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.803586 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.803727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.803881 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.804023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.804168 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.804316 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.804462 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.804645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.804829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805734 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.805963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.806305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.806407 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.806534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.806818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.806921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807008 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807145 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807284 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807538 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.807940 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808027 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808403 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808533 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:15:13.808773 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.808960 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.809272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.809575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.809879 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.810181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.810544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.810844 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.811179 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.811515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.811837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.812161 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.812477 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.812803 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.813115 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.813440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.813762 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.814077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.814659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.814772 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.815054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.815382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.815681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.815994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.816307 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.816620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.817126 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.817453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.817761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.818088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.818410 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.818756 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.819074 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.819386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.819716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.820029 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.820343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.820659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.820971 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.821282 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.821601 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.821920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.822246 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.822599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.822927 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.823257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.823605 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.823919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.824261 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.824590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.824908 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.825235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.825531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:15:13.825774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:15:13.832502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_db.sqlalchemy.engines [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:13.849895 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:13.901836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.context [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2df521c-6c27-48b0-b2f1-a0a30efe8016(cell1) {{(pid=117075) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:15:13.906639 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:15:13.908829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:15:13.909817 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:15:13.911971 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:15:13.913565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.context [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d2df521c-6c27-48b0-b2f1-a0a30efe8016(cell1) {{(pid=117074) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:15:13.918155 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:15:13.919821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:15:13.920681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:15:13.922767 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:15:13.924374 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_db.sqlalchemy.engines [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:13.929359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_db.sqlalchemy.engines [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:13.943017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:13.946592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:14.095195 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_db.sqlalchemy.engines [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:14.104784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:15:14.424244 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: WARNING keystonemiddleware.auth_token [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:15:14.427747 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: WARNING keystonemiddleware.auth_token [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:15:14.431752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: WARNING keystonemiddleware.auth_token [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:15:14.435230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: WARNING keystonemiddleware.auth_token [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:15:14.777943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: WARNING keystonemiddleware.auth_token [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:15:14.782175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: WARNING keystonemiddleware.auth_token [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:15:14.784193 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: WARNING keystonemiddleware.auth_token [None req-b8bb37f8-884d-48c0-a723-91e81e5f11c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:15:14.788479 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: WARNING keystonemiddleware.auth_token [None req-db5a2c51-1862-4ea7-9535-21abf2ec8d00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:15:14.789991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c85bc879c0 pid: 117074 (default app) May 12 17:15:14.793632 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c85bc879c0 pid: 117075 (default app) May 12 17:15:58.475522 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-26e7d186-7e34-42b2-b66a-32c8f8321467 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Action: 'create', calling method: .version_select at 0x7f78b54bf280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-961161694"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:15:59.791598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-26e7d186-7e34-42b2-b66a-32c8f8321467 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.220827 May 12 17:15:59.792658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1154 bytes} [Thu May 12 17:15:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3224 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 12 17:16:00.108335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-68b87750-b380-4ca7-950b-f28e0e4cb90c tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b554af70>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:00.531329 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-68b87750-b380-4ca7-950b-f28e0e4cb90c tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805" status: 200 len: 345 microversion: 2.1 time: 0.728840 May 12 17:16:00.532706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:15:59 2022] GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 => generated 345 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:00.545611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-47279200-d96b-449d-83f3-d7a27a7430fc tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Action: 'create', calling method: .version_select at 0x7f78b53801f0>, body: {"snapshot": {"volume_id": "986bc6a8-66b8-40ef-a46e-9b7f3410a805", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1123347503"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:00.634120 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1318942981", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "networks": [{"uuid": "e448eb24-07f0-4164-bcb9-ffce49adfff6"}]}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:00.754609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] validate_networks() for [('e448eb24-07f0-4164-bcb9-ffce49adfff6', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:16:01.031302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-47279200-d96b-449d-83f3-d7a27a7430fc tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.491167 May 12 17:16:01.031902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1161 bytes} [Thu May 12 17:16:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:01.038531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ce02b07e-218a-41ef-bffd-73dd87023071 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b5380280>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:01.192162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ce02b07e-218a-41ef-bffd-73dd87023071 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/10b08b62-f39d-4396-ac7c-51729f6a4410" status: 200 len: 351 microversion: 2.1 time: 0.159149 May 12 17:16:01.193612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:16:01 2022] GET /compute/v2.1/os-volumes/10b08b62-f39d-4396-ac7c-51729f6a4410 => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:01.198616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ccec6029-9472-459d-9d01-3aa13f7ea433 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b53800d0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:01.408148 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ccec6029-9472-459d-9d01-3aa13f7ea433 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 287 microversion: 2.1 time: 0.213082 May 12 17:16:01.408659 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 4/5] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:01 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:01.952546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-63aba16e-a0a5-4a82-b83b-f91ceabf8a50 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'create', calling method: .version_select at 0x7f78b531a0d0>, body: {"keypair": {"name": "tempest-keypair-468601648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGexu8Xdue3vkoMxmDYit1BAMtbjhRQ4J2MpOBbN0tUistLNReL5tr58BURoQxt1p63yN9gDUbQ4nvS759Yw0eD3WKcamvJsiJ++/uZgk4nwA77D3eB2kSRuPy8MnPOlw=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:02.042577 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-63aba16e-a0a5-4a82-b83b-f91ceabf8a50 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:02.065796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-63aba16e-a0a5-4a82-b83b-f91ceabf8a50 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for user 39a6070dad2d4b0e8d9c4004a396a66e and project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:02.106590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:16:02.107128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:16:02.107640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:16:02.108039 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:16:02.108551 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:16:02.130727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:02.131420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:02.133103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:02.133749 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:02.175318 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-63aba16e-a0a5-4a82-b83b-f91ceabf8a50 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.765370 May 12 17:16:02.176290 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 5/6] 10.222.0.23 () {62 vars in 1199 bytes} [Thu May 12 17:16:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 767 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 17:16:02.181459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-17f85d0b-1e03-4175-bb67-47c1376a6763 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b52ed5e0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:02.232954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Getting quotas for project 48b4bff5a47542c589d67a522647608c. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:02.256269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-17f85d0b-1e03-4175-bb67-47c1376a6763 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.078909 May 12 17:16:02.257015 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Getting quotas for user 9825c4125b9743bc9e4a6e9ac8a4cfac and project 48b4bff5a47542c589d67a522647608c. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:02.257376 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 6/7] 10.222.0.23 () {58 vars in 1139 bytes} [Thu May 12 17:16:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:02.267394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-124f74e1-e501-446a-8112-f56196f9cc6a tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b52ed700>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:02.300497 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:16:02.306185 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:16:02.306608 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-124f74e1-e501-446a-8112-f56196f9cc6a tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 287 microversion: 2.1 time: 0.043007 May 12 17:16:02.307186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 7/8] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:02 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:02.510288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e3ba1a04-c139-4e41-a8cb-b25923231d94 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.999312 May 12 17:16:02.513523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 2/9] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:16:02.527732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6d3ac159-9e9b-42c1-acfc-dfa67b2dab8f tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:02.529260 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6d3ac159-9e9b-42c1-acfc-dfa67b2dab8f tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:02.782502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6d3ac159-9e9b-42c1-acfc-dfa67b2dab8f tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:02.809279 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6d3ac159-9e9b-42c1-acfc-dfa67b2dab8f tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1215 microversion: 2.1 time: 0.284151 May 12 17:16:02.810254 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 8/10] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:02 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:03.326021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b78e69c8-3616-498d-a4a5-d388a5fab33f tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b4a293a0>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:03.408722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b78e69c8-3616-498d-a4a5-d388a5fab33f tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 287 microversion: 2.1 time: 0.093838 May 12 17:16:03.409436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 3/11] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:03 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:03.827759 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f4f0b0b6-6613-42b1-8eed-c3dfd9264683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:03.828369 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f4f0b0b6-6613-42b1-8eed-c3dfd9264683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:03.940457 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f4f0b0b6-6613-42b1-8eed-c3dfd9264683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:03.954996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f4f0b0b6-6613-42b1-8eed-c3dfd9264683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1215 microversion: 2.1 time: 0.131478 May 12 17:16:03.964793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 9/12] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:03 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:04.422253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0ffb5869-cae3-429a-a1d8-65cf222dba83 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b5315790>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:04.474021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0ffb5869-cae3-429a-a1d8-65cf222dba83 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 288 microversion: 2.1 time: 0.057293 May 12 17:16:04.475108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 4/13] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:04 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:04.486144 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6a2f5a32-9ac2-4bc3-9402-a5c5977c6c6e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b4a72820>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:04.670033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6a2f5a32-9ac2-4bc3-9402-a5c5977c6c6e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 202 len: 0 microversion: 2.1 time: 0.186464 May 12 17:16:04.671388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 10/14] 10.222.0.23 () {58 vars in 1253 bytes} [Thu May 12 17:16:04 2022] DELETE /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:16:04.680540 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a0a2586f-d6a0-44ae-9e7d-4916b080c054 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b4a29550>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:04.737759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a0a2586f-d6a0-44ae-9e7d-4916b080c054 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 287 microversion: 2.1 time: 0.061549 May 12 17:16:04.740492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 5/15] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:04 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:04.977427 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:04.978042 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:04.988179 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:04.988627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:04.991119 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:04.991565 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:05.293942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:05.315262 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-59e1ceff-0bd0-4f1f-9519-61af43218922 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1219 microversion: 2.1 time: 0.341494 May 12 17:16:05.315861 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 11/16] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:04 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1219 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:05.752835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-009fc600-2335-4f3e-a73f-c6149d947a76 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b4a299d0>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:05.820649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-009fc600-2335-4f3e-a73f-c6149d947a76 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 287 microversion: 2.1 time: 0.072467 May 12 17:16:05.821209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 6/17] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:05 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:06.332541 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:06.334230 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:06.342521 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:06.346027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:06.348077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:06.357222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:06.602598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-20743937", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77b21ff8-23c6-42d2-9321-6759378651ee"}], "security_groups": [{"name": "tempest-securitygroup--849741809"}], "key_name": "tempest-keypair-468601648", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:06.760504 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:06.775304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-78039afe-c704-4bd5-bf30-4cf4590d26a5 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1211 microversion: 2.1 time: 0.447315 May 12 17:16:06.785660 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 12/18] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:06 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1211 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:06.832091 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3084730f-d7f1-4ed1-9946-02cecfd4178d tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b49f55e0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:06.896695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3084730f-d7f1-4ed1-9946-02cecfd4178d tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 200 len: 287 microversion: 2.1 time: 0.068276 May 12 17:16:06.897387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 13/19] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:06 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:06.950507 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] validate_networks() for [('77b21ff8-23c6-42d2-9321-6759378651ee', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:16:07.555859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:16:07.556470 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:16:07.557016 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:16:07.557537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:16:07.558015 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:16:07.576491 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:07.595243 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:07.596606 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:07.597555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:07.634095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:07.650279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for user 39a6070dad2d4b0e8d9c4004a396a66e and project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:07.679004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:16:07.681256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:16:07.792469 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:07.793124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:07.803475 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-eff8c97d-6125-42f1-9e1b-adcf9c446afe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.189995 May 12 17:16:07.804420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 7/20] 10.222.0.23 () {62 vars in 1187 bytes} [Thu May 12 17:16:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 17:16:07.806756 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:07.807386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:07.812334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:07.812334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:07.819675 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0ebc5976-3a0b-49c8-92aa-bec105d7f44d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:07.820295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0ebc5976-3a0b-49c8-92aa-bec105d7f44d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:08.100133 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0ebc5976-3a0b-49c8-92aa-bec105d7f44d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:08.157872 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0ebc5976-3a0b-49c8-92aa-bec105d7f44d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:08.159864 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0ebc5976-3a0b-49c8-92aa-bec105d7f44d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:08.167918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0ebc5976-3a0b-49c8-92aa-bec105d7f44d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1279 microversion: 2.20 time: 0.351805 May 12 17:16:08.172975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 8/21] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:07 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1279 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:16:08.179631 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a510bfe4-ccfb-404e-b6ea-05ab03338108 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b41e3040>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:08.196284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:08.205009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1b7bdea6-2d11-4a4a-aa4e-f839065ae042 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1267 microversion: 2.1 time: 0.416556 May 12 17:16:08.211448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 14/22] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:07 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1267 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:08.241004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-a510bfe4-ccfb-404e-b6ea-05ab03338108 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] HTTP exception thrown: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a510bfe4-ccfb-404e-b6ea-05ab03338108 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Request method failure captured: May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c HTTP/1.1 May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDMk8LiSFINjLd0cCJLw0dqbdACROc31ERtFw2f5Rp_5A97IJ09v5BxJSkam2Tx0QCi6As82EZ6gH2LOoDcpjPcrMVWTDxrtTm4YNhrCxKAw-pzv_TOE0KZWQuMyOgKVU476AxfCIidyO4diRCrnH2Z3LPud8pSSQxOkxL8j49XZno May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:16:08.251533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6db872977f124e5aa548e551c2a3e255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 29e561a6378142ea829af7f6ab02915c May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': 'b9385010-2d0a-4bc0-9090-0114a70d7c4c'} May 12 17:16:08.252905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. (HTTP 404) (Request-ID: req-a9c2d9fe-c1da-4940-9812-dccd4d29ad10) May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.253706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:16:08.254810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 17:16:08.255922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a510bfe4-ccfb-404e-b6ea-05ab03338108 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Returning 404 to user: Snapshot b9385010-2d0a-4bc0-9090-0114a70d7c4c could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a510bfe4-ccfb-404e-b6ea-05ab03338108 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c" status: 404 len: 111 microversion: 2.1 time: 0.079100 May 12 17:16:08.257354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 9/23] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:16:08 2022] GET /compute/v2.1/os-snapshots/b9385010-2d0a-4bc0-9090-0114a70d7c4c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:16:08.263923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b93ff426-60a8-4579-b84e-af5989b04327 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b49ff4c0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:08.420185 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b93ff426-60a8-4579-b84e-af5989b04327 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805" status: 202 len: 0 microversion: 2.1 time: 0.159452 May 12 17:16:08.421285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 15/24] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:16:08 2022] DELETE /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:16:08.429960 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9ad6c403-6cb5-4785-beb3-0a57638a7d4a tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b41c4160>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:08.573514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9ad6c403-6cb5-4785-beb3-0a57638a7d4a tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805" status: 200 len: 344 microversion: 2.1 time: 0.148298 May 12 17:16:08.574677 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 10/25] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:16:08 2022] GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:08.596839 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d5fef82c-3b34-4334-9782-3dd0a084749c tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b49a8940>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:08.683195 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d5fef82c-3b34-4334-9782-3dd0a084749c tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffd15298-8caf-4781-a7c9-07030bef9d14" status: 200 len: 350 microversion: 2.1 time: 0.090352 May 12 17:16:08.684308 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 16/26] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:16:08 2022] GET /compute/v2.1/os-volumes/ffd15298-8caf-4781-a7c9-07030bef9d14 => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:09.189768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-fdcf6793-76fd-4018-ad28-f54cec14273b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:09.190383 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-fdcf6793-76fd-4018-ad28-f54cec14273b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:09.227594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:09.228782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:09.241122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:09.258661 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:09.261342 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:09.263069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:09.336465 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fdcf6793-76fd-4018-ad28-f54cec14273b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:09.346251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fdcf6793-76fd-4018-ad28-f54cec14273b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:09.352952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fdcf6793-76fd-4018-ad28-f54cec14273b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:09.356678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-fdcf6793-76fd-4018-ad28-f54cec14273b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1279 microversion: 2.20 time: 0.171899 May 12 17:16:09.360272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 11/27] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:09 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:09.586262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4c09d4b9-129a-4294-a178-34cd1a35e482 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b41c4940>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:09.634442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-4c09d4b9-129a-4294-a178-34cd1a35e482 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] HTTP exception thrown: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4c09d4b9-129a-4294-a178-34cd1a35e482 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Request method failure captured: May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 HTTP/1.1 May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDMk8LiSFINjLd0cCJLw0dqbdACROc31ERtFw2f5Rp_5A97IJ09v5BxJSkam2Tx0QCi6As82EZ6gH2LOoDcpjPcrMVWTDxrtTm4YNhrCxKAw-pzv_TOE0KZWQuMyOgKVU476AxfCIidyO4diRCrnH2Z3LPud8pSSQxOkxL8j49XZno May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:16:09.636805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6db872977f124e5aa548e551c2a3e255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 29e561a6378142ea829af7f6ab02915c May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '986bc6a8-66b8-40ef-a46e-9b7f3410a805'} May 12 17:16:09.638114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. (HTTP 404) (Request-ID: req-b4c6a0f1-384a-4db9-a574-f03364ce10b0) May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.639183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:16:09.640394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:16:09.641592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4c09d4b9-129a-4294-a178-34cd1a35e482 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Returning 404 to user: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4c09d4b9-129a-4294-a178-34cd1a35e482 tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805" status: 404 len: 109 microversion: 2.1 time: 0.055801 May 12 17:16:09.642870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 12/28] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:16:09 2022] GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:16:09.655206 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2cd26867-a4ca-45fc-bac9-781ace31f9ae tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b414cb80>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:09.667532 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:09.680263 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9be40f7e-06d7-403f-8932-0f784c74fb99 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1273 microversion: 2.1 time: 0.455933 May 12 17:16:09.683230 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 17/29] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:09 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1273 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:09.724833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-2cd26867-a4ca-45fc-bac9-781ace31f9ae tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] HTTP exception thrown: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2cd26867-a4ca-45fc-bac9-781ace31f9ae tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Request method failure captured: May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: DELETE /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 HTTP/1.1 May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDMk8LiSFINjLd0cCJLw0dqbdACROc31ERtFw2f5Rp_5A97IJ09v5BxJSkam2Tx0QCi6As82EZ6gH2LOoDcpjPcrMVWTDxrtTm4YNhrCxKAw-pzv_TOE0KZWQuMyOgKVU476AxfCIidyO4diRCrnH2Z3LPud8pSSQxOkxL8j49XZno May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:16:09.726840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6db872977f124e5aa548e551c2a3e255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 29e561a6378142ea829af7f6ab02915c May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '986bc6a8-66b8-40ef-a46e-9b7f3410a805'} May 12 17:16:09.727897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. (HTTP 404) (Request-ID: req-2078a5c6-6ee8-4ee6-b528-798e7a55ed65) May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.728556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:16:09.732004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:16:09.736952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2cd26867-a4ca-45fc-bac9-781ace31f9ae tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Returning 404 to user: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2cd26867-a4ca-45fc-bac9-781ace31f9ae tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805" status: 404 len: 109 microversion: 2.1 time: 0.077471 May 12 17:16:09.737850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 13/30] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:16:09 2022] DELETE /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:16:09.740989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4f30135e-3ae6-45e4-b243-825ac6d10b2e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Calling method '.version_select at 0x7f78b49f5dc0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:09.805297 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-4f30135e-3ae6-45e4-b243-825ac6d10b2e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] HTTP exception thrown: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4f30135e-3ae6-45e4-b243-825ac6d10b2e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Request method failure captured: May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 HTTP/1.1 May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDMk8LiSFINjLd0cCJLw0dqbdACROc31ERtFw2f5Rp_5A97IJ09v5BxJSkam2Tx0QCi6As82EZ6gH2LOoDcpjPcrMVWTDxrtTm4YNhrCxKAw-pzv_TOE0KZWQuMyOgKVU476AxfCIidyO4diRCrnH2Z3LPud8pSSQxOkxL8j49XZno May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:16:09.809447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6db872977f124e5aa548e551c2a3e255"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6db872977f124e5aa548e551c2a3e255"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 6db872977f124e5aa548e551c2a3e255 May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-497022029 May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 29e561a6378142ea829af7f6ab02915c May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesSnapshotsTestJSON-497022029-project May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '986bc6a8-66b8-40ef-a46e-9b7f3410a805'} May 12 17:16:09.810792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. (HTTP 404) (Request-ID: req-1f4560c5-398a-4fa1-830f-abe620799468) May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.811473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:16:09.812435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:16:09.813445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4f30135e-3ae6-45e4-b243-825ac6d10b2e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] Returning 404 to user: Volume 986bc6a8-66b8-40ef-a46e-9b7f3410a805 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:16:09.814996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4f30135e-3ae6-45e4-b243-825ac6d10b2e tempest-VolumesSnapshotsTestJSON-497022029 tempest-VolumesSnapshotsTestJSON-497022029-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805" status: 404 len: 109 microversion: 2.1 time: 0.076664 May 12 17:16:09.817650 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:16:09 2022] GET /compute/v2.1/os-volumes/986bc6a8-66b8-40ef-a46e-9b7f3410a805 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:16:10.379372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:10.386716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:10.390857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:10.410270 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:10.413000 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:10.416347 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:10.701104 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:10.701902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:10.721509 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:10.721961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:10.722865 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:10.723235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:10.861585 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:10.869875 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d563e178-79e6-4dbe-b68b-1ef163f714e7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1273 microversion: 2.1 time: 0.173705 May 12 17:16:10.871142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 19/32] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:10 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:10.925619 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:11.001346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:11.003350 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:11.004739 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-43d05f41-02e9-40f8-9b5d-42fab04cf46f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1283 microversion: 2.20 time: 0.631068 May 12 17:16:11.016932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 14/33] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:10 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1283 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:11.889310 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:11.889947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:11.910239 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:11.910737 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:11.911538 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:11.913989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:12.024745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:12.025352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:12.045852 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:12.047015 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:12.048225 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:12.048982 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:12.318964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:12.323221 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:12.327652 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8c9976db-eed6-4246-8cfc-ad3a27324153 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.443562 May 12 17:16:12.331186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 20/34] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:11 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:12.345343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:12.351181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:12.356670 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bf722cb4-f52a-4a26-8bef-f8655bc3ec63 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1283 microversion: 2.20 time: 0.332246 May 12 17:16:12.368168 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 15/35] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:12 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1283 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:12.914022 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ffe5482a-25f1-456b-bd1d-c3fadbc67411 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b40e3310>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:13.108794 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ffe5482a-25f1-456b-bd1d-c3fadbc67411 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e02d39a-bad2-49de-ad31-d9956824ab57" status: 200 len: 350 microversion: 2.1 time: 0.198443 May 12 17:16:13.111643 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 16/36] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:16:12 2022] GET /compute/v2.1/os-volumes/7e02d39a-bad2-49de-ad31-d9956824ab57 => generated 350 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:13.132998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-25770e7f-8d80-45e7-ab52-2af5b1003ead tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b4145820>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:13.214414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1971091873", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:13.530213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] validate_networks() for [('ff0d6338-2300-4010-ae74-9c2289a9588a', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:16:13.562930 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-25770e7f-8d80-45e7-ab52-2af5b1003ead tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.440395 May 12 17:16:13.563510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 17/37] 10.222.0.23 () {58 vars in 1133 bytes} [Thu May 12 17:16:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:13.571247 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:13.571247 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:13.608466 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:13.608936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:13.609840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:13.610336 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:16.135771 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:16:16.136352 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:16:16.136745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:16:16.137802 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:16:16.138322 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:16:16.163387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:16.163880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:16.165899 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:16.166443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:16.258302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for project 638166bec22640968de80cfeaeed437b. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:16.274788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for user 650969502a9f41e38066a7c269d84ab7 and project 638166bec22640968de80cfeaeed437b. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:16.313602 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:16:16.324266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:16:16.469521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:16.477924 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5d615a8b-032f-4346-a9a4-3dd1ceb996f3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 2.913321 May 12 17:16:16.482037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 18/38] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:13 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 2918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:16.495065 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:16.495685 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:16.502308 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-374a62c3-a02f-41c2-a530-ce9769c526d9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.037235 May 12 17:16:16.503812 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 21/39] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:16:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 4040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:16:16.510245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f346737e-136e-4fea-a45d-3c3ed89f67b2 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b48dc3a0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:16.536442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:16.540105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:16.540958 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:16.541408 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:16.789017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f346737e-136e-4fea-a45d-3c3ed89f67b2 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.283658 May 12 17:16:16.789597 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1148 bytes} [Thu May 12 17:16:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:16.796891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-43bf53cb-7188-4e7c-b3b8-e2cdac443635 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:16.796891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-43bf53cb-7188-4e7c-b3b8-e2cdac443635 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:16.851417 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:16.862128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:16.866062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:16.871312 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6daed8dc-8e37-4f8f-a3ed-b6d93934b4a0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1337 microversion: 2.20 time: 0.387722 May 12 17:16:16.872749 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 19/41] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:16 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1337 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:16.893843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3b4e2e9e-c06c-433d-a185-90e5954725fa tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b4109c10>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:17.010754 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-43bf53cb-7188-4e7c-b3b8-e2cdac443635 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:17.018957 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-43bf53cb-7188-4e7c-b3b8-e2cdac443635 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1222 microversion: 2.1 time: 0.227659 May 12 17:16:17.035112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:16 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:17.075421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3b4e2e9e-c06c-433d-a185-90e5954725fa tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.198915 May 12 17:16:17.075940 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1133 bytes} [Thu May 12 17:16:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:17.093125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-78b4388e-b81e-4b9c-91de-44023258d9e9 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b40e3940>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:17.318505 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-78b4388e-b81e-4b9c-91de-44023258d9e9 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.234839 May 12 17:16:17.320223 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1166 bytes} [Thu May 12 17:16:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:17.334084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7b3125df-7749-43a8-ad94-f59bc8e4f05e tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b40a4280>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:17.537020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7b3125df-7749-43a8-ad94-f59bc8e4f05e tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.208900 May 12 17:16:17.537607 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1169 bytes} [Thu May 12 17:16:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:17.549168 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1089294653", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:17.631002 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] validate_networks() for [('ff0d6338-2300-4010-ae74-9c2289a9588a', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:16:17.659292 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bcc2d306-28fd-4afc-a241-3124c1fdc4cd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: .version_select at 0x7f78b48dc280>, body: {"keypair": {"name": "tempest-keypair-2039403169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGDKRPF8hZP/8sDgrvnllNLWe3d6JQhxr6pJrgpOBTf4oa/Utl7XTRL+Y8T+7IUOz8XKbJgLVtVoWWfy4W3QeiIl41lpX3Dy8RclM8yCeeEtPRxeex8mvS/MWwLvzxdtA=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:17.684210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-bcc2d306-28fd-4afc-a241-3124c1fdc4cd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:17.695288 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-bcc2d306-28fd-4afc-a241-3124c1fdc4cd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for user f73a65ebe334405099f7a4f95c4a4df6 and project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:17.742368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bcc2d306-28fd-4afc-a241-3124c1fdc4cd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.705486 May 12 17:16:17.743017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:16:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:17.756487 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:17.758832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:17.769883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:17.771571 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:17.778804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:17.779883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.169624 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:18.186221 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-858ee142-158c-4bb8-ac8d-0e80d907fbd3 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.437353 May 12 17:16:18.198295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 25/47] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:17 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:18.204855 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-19c21f40-9f56-4578-a603-e6dc64f438ba tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b48c4550>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:18.369646 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-19c21f40-9f56-4578-a603-e6dc64f438ba tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.169799 May 12 17:16:18.370515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 26/48] 10.222.0.23 () {58 vars in 1154 bytes} [Thu May 12 17:16:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:18.376866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:18.377725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:18.407508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:16:18.408142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:16:18.409086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:16:18.409637 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:16:18.411123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:16:18.423241 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.426065 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.428718 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.430028 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.439344 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.440321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.442040 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.442712 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.519316 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for project 638166bec22640968de80cfeaeed437b. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:18.530462 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for user 650969502a9f41e38066a7c269d84ab7 and project 638166bec22640968de80cfeaeed437b. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:18.555322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:16:18.557857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:16:18.610457 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:18.618486 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:18.620098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:18.621839 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-025ad6d3-61f9-4bff-bdc5-0367473c4e57 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1337 microversion: 2.20 time: 0.248677 May 12 17:16:18.622413 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 27/49] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:18 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1337 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:18.681142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ca603153-c900-46d1-a632-ca2c26fafa43 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.142483 May 12 17:16:18.682253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 23/50] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:16:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:16:18.689079 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-834a87aa-e3b6-4125-9714-f92ca675d403 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b40e3310>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:18.811231 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-ba1c2b5e-0dd7-4b33-8b92-78d07dc27ee4 req-193f9455-ab31-4499-b520-61b39560e5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c5e2e9-90b0-49d3-a43a-4ab2e6346af2", "tag": "c3f98d92-aa4f-4644-b6e9-33c2db6e68f7"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:18.826009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-ba1c2b5e-0dd7-4b33-8b92-78d07dc27ee4 req-193f9455-ab31-4499-b520-61b39560e5db service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.826891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-ba1c2b5e-0dd7-4b33-8b92-78d07dc27ee4 req-193f9455-ab31-4499-b520-61b39560e5db service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.853389 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-ba1c2b5e-0dd7-4b33-8b92-78d07dc27ee4 req-193f9455-ab31-4499-b520-61b39560e5db service nova] Creating event network-changed:c3f98d92-aa4f-4644-b6e9-33c2db6e68f7 for instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 on hv-cinder-84159 May 12 17:16:18.854077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-ba1c2b5e-0dd7-4b33-8b92-78d07dc27ee4 req-193f9455-ab31-4499-b520-61b39560e5db service nova] Acquired lock "compute-rpcapi-router" {{(pid=117075) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 17:16:18.855418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.857281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.858205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:18.858749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:18.878974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.compute.rpcapi [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 17:16:18.887804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117075) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 17:16:18.919754 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5970b78c-bb66-4088-91bc-d684a9570fb4 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279209 May 12 17:16:18.920369 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 28/51] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:18.925712 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-542a7a4e-2c2b-4c7e-b143-af657c3191ee tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:18.928598 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-542a7a4e-2c2b-4c7e-b143-af657c3191ee tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:19.078091 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-542a7a4e-2c2b-4c7e-b143-af657c3191ee tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:19.089510 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-542a7a4e-2c2b-4c7e-b143-af657c3191ee tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1222 microversion: 2.1 time: 0.165066 May 12 17:16:19.102503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 29/52] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:18 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:19.204799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:19.205617 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:19.217766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:19.218218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:19.225292 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:19.227238 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-834a87aa-e3b6-4125-9714-f92ca675d403 tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.542983 May 12 17:16:19.227664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:19.228660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 24/53] 10.222.0.23 () {58 vars in 1187 bytes} [Thu May 12 17:16:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:19.241136 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-67738d7b-61b9-4031-beef-98ff8107ca0e tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] Calling method '.version_select at 0x7f78b40a4a60>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:19.574017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:19.595132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e2e44fec-0619-4ca5-98f4-cccc823195ab tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.394566 May 12 17:16:19.596094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 30/54] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:19 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:19.631261 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-67738d7b-61b9-4031-beef-98ff8107ca0e tempest-VolumesTestJSON-1486377920 tempest-VolumesTestJSON-1486377920-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.395040 May 12 17:16:19.632292 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 25/55] 10.222.0.23 () {58 vars in 1154 bytes} [Thu May 12 17:16:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:19.648524 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:19.649529 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:19.670361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:19.672813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:19.676949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:19.678134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:19.866620 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:19.880023 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:19.891524 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:19.892770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9a41d9ac-b17c-4206-972b-42e5a60df06c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1337 microversion: 2.20 time: 0.254648 May 12 17:16:19.893429 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 31/56] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:19 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1337 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:20.111823 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:20.113311 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:20.145640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:20.146274 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:20.151805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:20.158819 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:20.371197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:20.410355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5ad0a43e-df15-4307-91f0-f1f486387dfc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1218 microversion: 2.1 time: 0.304007 May 12 17:16:20.412209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 26/57] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:20 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:20.613596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:20.614635 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:20.635631 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:20.641734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:20.643374 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:20.647061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:20.920731 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:20.922902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:20.930156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:20.930992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:20.932241 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:20.932892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:21.135035 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:21.150854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4cc1c750-4b70-4bbd-9d44-6461697322f1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.542082 May 12 17:16:21.158037 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 32/58] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:20 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:21.197784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:21.224630 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:21.226690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:21.227978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-aa6f58ee-b03e-4564-9fee-8f53f2f47b35 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1337 microversion: 2.20 time: 0.315194 May 12 17:16:21.256593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 27/59] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:20 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1337 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:21.429848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:21.430570 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:21.443077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:21.446687 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:21.447699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:21.450723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:22.073841 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:22.086878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-55f6fe0c-5688-46f0-972c-0b960626f715 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1274 microversion: 2.1 time: 0.661605 May 12 17:16:22.091357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 33/60] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:21 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1274 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:22.178482 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:22.179586 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:22.196401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:22.203162 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:22.207124 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:22.211053 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:22.249522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:22.250145 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:22.272159 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:22.272621 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:22.273641 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:22.273946 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:22.683648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:22.706993 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:22.721860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:22.727888 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c30a724f-024d-42d1-9e2f-5e2e5d09fb8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1337 microversion: 2.20 time: 0.483552 May 12 17:16:22.735059 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 34/61] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:22 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1337 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:23.107132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:23.107892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:23.113928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:23.114367 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:23.115370 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:23.116022 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:23.124545 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:23.134790 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4bf176ab-5f25-4de2-947a-3a4963d06b2a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.960479 May 12 17:16:23.145346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 28/62] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:22 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:23.236058 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:23.251412 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d45bc695-4156-4ced-9055-93056b0c8ec8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.146731 May 12 17:16:23.254885 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 35/63] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:23 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:23.320064 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-287140961", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e057b02-0e5b-44bd-83b7-2f23a5bc0a94"}], "security_groups": [{"name": "tempest-securitygroup--1534560738"}], "key_name": "tempest-keypair-2039403169", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:23.484179 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] validate_networks() for [('8e057b02-0e5b-44bd-83b7-2f23a5bc0a94', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:16:23.753688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:23.754662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:23.761519 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:23.763057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:23.764213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:23.764848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:23.929912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:23.938304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:23.939823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:23.940932 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c5efbcde-d27a-4862-9fe3-f7dbb55793bb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.192161 May 12 17:16:23.941492 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 36/64] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:23 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:24.153183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:24.153690 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:24.161336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.161924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.162953 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.163393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.298682 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:16:24.299112 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:16:24.299596 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:16:24.300576 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:16:24.301005 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:16:24.317468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.318036 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.321550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.322152 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.340276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:24.352521 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ec7c9931-da23-48c5-b169-6a8758f44aa7 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.203419 May 12 17:16:24.353663 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 37/65] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:24 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:24.359938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:24.360704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:24.364684 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:16:24.366910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.367527 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.368326 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.368774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.368879 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for user f73a65ebe334405099f7a4f95c4a4df6 and project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:16:24.383849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:16:24.385973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:16:24.447078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:24.455366 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-85a50fee-0f0c-41a9-92c4-19f2d66a4bfe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.100472 May 12 17:16:24.464445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 38/66] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:24 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:24.470726 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6507c607-716e-4c10-864d-383530926bd5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.160160 May 12 17:16:24.471532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 29/67] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:16:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:16:24.481208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-02ecbc97-31ce-4852-b884-f5d9bbf80fea tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:24.482164 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-02ecbc97-31ce-4852-b884-f5d9bbf80fea tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:24.547120 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-02ecbc97-31ce-4852-b884-f5d9bbf80fea tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:24.554864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-02ecbc97-31ce-4852-b884-f5d9bbf80fea tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1237 microversion: 2.1 time: 0.077384 May 12 17:16:24.564393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 39/68] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:24 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:24.960002 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:24.960750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:24.966964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.967417 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:24.968182 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:24.968640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.101045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:25.109317 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:25.110848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:25.111990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3e588f8f-64c5-4c2f-9ffe-3a200399f6bf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.156056 May 12 17:16:25.112690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 30/69] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:24 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:25.368819 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:25.369424 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:25.376335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:25.376807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.377561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:25.377991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.473493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:25.475639 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:25.482738 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:25.483123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.483917 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:25.484507 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.515760 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:25.521353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e0d49c47-bd3d-48c5-b3ba-99b2aedc9c73 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.156327 May 12 17:16:25.531702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 40/70] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:25 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:25.571246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:25.572777 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:25.579230 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:25.579667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.584665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:25.584665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:25.599976 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:25.615928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b0278490-605d-40ad-8195-47f789ce62a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.147405 May 12 17:16:25.626240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 31/71] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:25 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:25.695854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:25.704864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b4cd55b3-0fc4-493e-abac-a37b3944bbca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1241 microversion: 2.1 time: 0.137299 May 12 17:16:25.706748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 41/72] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:25 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:26.133492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:26.134576 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:26.141259 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.155980 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.157309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.158145 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.323932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:26.332852 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:26.334341 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:26.335798 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-95206591-9565-4025-bd9b-4d7ae60fa4f8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.208233 May 12 17:16:26.346945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 32/73] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:26 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:26.539320 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:26.540310 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:26.547053 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.547803 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.548799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.549417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.644665 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:26.646051 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:26.656806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.657251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.666488 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.666946 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.748271 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:26.757729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5421d234-011a-442a-9e44-a8397926f921 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.221663 May 12 17:16:26.768778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 42/74] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:26 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:26.770911 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:26.773182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:26.773794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:26.779624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-053dfa45-c943-423f-aa0b-27fec7f91fbe tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.149877 May 12 17:16:26.780191 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 33/75] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:26 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:26.781192 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.781845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.782716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:26.783414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:26.861905 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:26.874125 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0db0ee7a-bc79-4c70-ab98-9aa468b6453b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1241 microversion: 2.1 time: 0.104596 May 12 17:16:26.874739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 43/76] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:26 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:27.356554 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:27.357806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:27.374085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.374902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.375899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.376551 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.539563 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:27.549911 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:27.552111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:27.553689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0b52f66a-b631-4ad1-aa61-c2c2e9cb9319 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.203326 May 12 17:16:27.555051 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 34/77] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:27 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:27.776353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:27.777211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:27.785962 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.791782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.793149 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.793760 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.800486 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:27.802141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:27.811512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.812447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.813603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.814389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.948433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:27.957785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8f698d19-34c9-4a60-9980-9137f68b2c27 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.164286 May 12 17:16:27.958574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 35/78] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:27 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:27.966734 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:27.967669 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:27.975107 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.976637 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:27.977440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:27.978032 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:28.027959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:28.035409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-cb8a18b2-3a50-4ee7-b2b4-5251a1593dfe tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.264357 May 12 17:16:28.035986 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 44/79] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:27 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:28.055702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:28.069175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f78a7a78-a87b-4de5-993f-c2259d64f9ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1241 microversion: 2.1 time: 0.109302 May 12 17:16:28.069782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 36/80] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:27 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:28.579742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:28.580335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:28.586157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:28.590142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:28.590142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:28.590142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:28.716425 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:28.724484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:28.725960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:28.727082 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d0278a09-31c5-44b0-84b5-6fca0307db49 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.151260 May 12 17:16:28.727633 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 45/81] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:28 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:28.977823 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:28.979739 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:28.987406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:28.987929 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:28.988801 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:28.989338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:29.052959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:29.053536 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:29.053659 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:29.059928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:29.060409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:29.060832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b984ae94-4943-497b-8dee-76ed28533ae5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.087864 May 12 17:16:29.061095 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:29.061675 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 37/82] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:28 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:29.062025 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:29.085995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:29.086695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:29.093524 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:29.093974 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:29.094778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:29.095293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:29.239696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:29.248972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a4bd1a6c-2eae-492f-96c1-dc8dc7fe2a7d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1241 microversion: 2.1 time: 0.166848 May 12 17:16:29.252788 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 38/83] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:29 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:29.294069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:29.322803 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e38f2214-3b6f-499a-8873-ae9ac4faa093 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.273828 May 12 17:16:29.327403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 46/84] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:29 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:29.747784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:29.748544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:29.754821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:29.762275 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:29.763304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:29.763934 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.078692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:30.080611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:30.087672 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:30.088113 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.088875 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:30.089307 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.117145 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:30.137594 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:30.141517 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:30.142682 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-773be37a-7be6-40b2-b5b1-246bfac54732 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.401410 May 12 17:16:30.143239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 39/85] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:29 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:30.169360 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:30.176581 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-03c20ab1-7555-4d30-bcd5-07342041e7c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1280 microversion: 2.1 time: 0.103246 May 12 17:16:30.177142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 47/86] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:30 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:30.279118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:30.279882 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:30.286057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:30.286629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.287721 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:30.288156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.343387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:30.344075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:30.351769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:30.357068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.357784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:30.358383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:30.397454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:30.406779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a6dcc1fa-f116-4c91-a205-9d030b626612 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1289 microversion: 2.1 time: 0.131514 May 12 17:16:30.407356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 40/87] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:30 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:30.600631 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:30.617086 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e4025eca-b5b7-480f-b736-2bca164720a9 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.275920 May 12 17:16:30.619543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 48/88] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:30 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:31.152780 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-2d6a4401-39ef-42a5-b45c-971378ebbe6e req-9706e6fb-5d48-4481-a346-26d68b2cd367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674ec2ad-d5d1-46d6-b683-b5c2bd561c9a", "tag": "d57d4a88-7f65-442d-9424-fce30450293a"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:31.161599 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:31.162405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:31.174802 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.176488 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.177976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.182274 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.182868 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2d6a4401-39ef-42a5-b45c-971378ebbe6e req-9706e6fb-5d48-4481-a346-26d68b2cd367 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.183335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2d6a4401-39ef-42a5-b45c-971378ebbe6e req-9706e6fb-5d48-4481-a346-26d68b2cd367 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.234318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-2d6a4401-39ef-42a5-b45c-971378ebbe6e req-9706e6fb-5d48-4481-a346-26d68b2cd367 service nova] Creating event network-changed:d57d4a88-7f65-442d-9424-fce30450293a for instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a on hv-cinder-84159 May 12 17:16:31.234987 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2d6a4401-39ef-42a5-b45c-971378ebbe6e req-9706e6fb-5d48-4481-a346-26d68b2cd367 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 17:16:31.236190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.236777 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.237669 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.238089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.285614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.compute.rpcapi [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 17:16:31.290724 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] Releasing lock "compute-rpcapi-router" {{(pid=117074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 17:16:31.315628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-23039570-7d15-48ed-9b99-0b0d4347adbe None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167333 May 12 17:16:31.316717 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 41/89] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:31.326140 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:31.327059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:31.335881 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.336442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.337393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.338259 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.641286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:31.650199 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:31.656518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:31.658104 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d79313d6-8e89-4a88-a3aa-c4ac01846cbe tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.501842 May 12 17:16:31.659245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 49/90] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:31 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:31.668332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:31.669356 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:31.688596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.691307 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.693934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.694895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.841497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:31.864663 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-261248d9-b840-4245-a94a-2fc59289ef1b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1295 microversion: 2.1 time: 0.202364 May 12 17:16:31.865969 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 50/91] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:31 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:31.874351 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:31.874991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:31.888010 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.888558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:31.889809 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:31.890331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:32.067184 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:32.075999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-80fae44b-0932-4c93-b4c7-cf088d29c418 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.757755 May 12 17:16:32.077647 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 42/92] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:31 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:32.300894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:32.309816 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b2473b51-8fe3-4ce0-8517-25f8e1cf6fc2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.441998 May 12 17:16:32.320972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 51/93] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:31 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:32.681561 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:32.681561 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:32.693020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:32.693733 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:32.694603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:32.695035 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:32.901446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:32.902106 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:32.915163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:32.915729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:32.916617 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:32.917173 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:32.979652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:32.990656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:32.992304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:32.993945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f2742a5c-20cd-4c29-8e9e-223e6ab6b6ff tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.321117 May 12 17:16:33.009740 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:33.010776 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 43/94] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:32 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:33.019602 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-668a847b-a160-42a8-85ce-717893ebbb24 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1295 microversion: 2.1 time: 0.135066 May 12 17:16:33.021010 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 52/95] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:32 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1295 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:33.093592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:33.094186 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:33.100952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:33.101442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:33.102276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:33.102733 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:33.265935 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:33.277307 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-83b79cd1-89a4-46c5-8277-4ec8efa95b3b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.187789 May 12 17:16:33.278338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 44/96] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:33 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:33.328337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:33.330271 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:33.338077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:33.338813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:33.339970 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:33.340597 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:33.346564 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-daeed207-7387-4306-a044-ac46a751c287 req-a07d4e45-c60e-4d70-babd-d4897792ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}, {"name": "network-changed", "server_uuid": "68fea2bf-d6a6-4a97-be8f-bd754b36e60c", "tag": "4b14ecbe-91e8-4995-96ec-24bef4c83422"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:33.360290 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-daeed207-7387-4306-a044-ac46a751c287 req-a07d4e45-c60e-4d70-babd-d4897792ba11 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:33.361233 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-daeed207-7387-4306-a044-ac46a751c287 req-a07d4e45-c60e-4d70-babd-d4897792ba11 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:33.385351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-daeed207-7387-4306-a044-ac46a751c287 req-a07d4e45-c60e-4d70-babd-d4897792ba11 service nova] Creating event network-changed:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:16:33.385909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-daeed207-7387-4306-a044-ac46a751c287 req-a07d4e45-c60e-4d70-babd-d4897792ba11 service nova] Creating event network-changed:4b14ecbe-91e8-4995-96ec-24bef4c83422 for instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c on hv-cinder-84159 May 12 17:16:33.394685 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-daeed207-7387-4306-a044-ac46a751c287 req-a07d4e45-c60e-4d70-babd-d4897792ba11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054345 May 12 17:16:33.395299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 45/97] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:33.492270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:33.500887 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-58b3b799-4855-471a-bc8e-fba44f48c683 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.177165 May 12 17:16:33.501538 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 53/98] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:33 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:34.022907 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:34.023735 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:34.041140 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.041609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.041958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:34.042626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:34.046125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.046837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.057507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.058021 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.059146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.063741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.195985 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:34.205494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7e91b504-cd8c-452f-81a7-2b38c1d8e8ee tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1295 microversion: 2.1 time: 0.170158 May 12 17:16:34.206364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 54/99] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:34 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1295 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:34.273913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:34.282344 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:34.284107 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:34.285211 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-841a88c1-33ef-4fd2-872e-770ed2df9251 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.271452 May 12 17:16:34.286369 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 46/100] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:34 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:34.294297 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:34.294940 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:34.300843 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.301525 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.302442 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.303033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.441382 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:34.449698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-23e89537-57e5-485d-ba5b-8edf5612b355 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.158612 May 12 17:16:34.450579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 55/101] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:34 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:34.520649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:34.521745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:34.529768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.530079 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:34.531080 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:34.531857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.068699 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:35.076501 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1dc3045e-1397-4a37-8559-837c9916dda2 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.560858 May 12 17:16:35.087365 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 47/102] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:34 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:35.223904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:35.224750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:35.237883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:35.238837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.242154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:35.242859 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.304130 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:35.304936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:35.314727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:35.315179 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.315961 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:35.316532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.803157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:35.813050 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bb2910dc-d013-41ba-a47f-926498cae9af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.594944 May 12 17:16:35.814837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 56/103] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:35 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:35.820446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:35.821212 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:35.829197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:35.830030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.831137 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:35.831763 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:35.969270 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:35.983420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:35.986912 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:35.993708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-90aa1138-73c3-4b70-b763-5de464a99021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.690957 May 12 17:16:35.996551 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 48/104] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:35 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:36.045439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:36.053602 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bc640023-39ad-4cd8-afc3-d00f0eb20b48 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.237188 May 12 17:16:36.054109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 57/105] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:35 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:36.096624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:36.098042 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:36.105787 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:36.106476 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:36.107624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:36.108123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:36.250741 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:36.258589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9ed2ed84-8985-42b9-8e3d-759bf533b419 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.169185 May 12 17:16:36.259800 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 49/106] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:36 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:36.830808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:36.831417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:36.837249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:36.837691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:36.838478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:36.838909 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:36.979163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:36.996422 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6df9915b-c29c-4f58-81be-bfae653862e6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.169564 May 12 17:16:36.997951 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 58/107] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:36 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:37.013597 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:37.014356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:37.022521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:37.023084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:37.023925 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:37.024450 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:37.070629 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:37.071236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:37.077380 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:37.078020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:37.078817 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:37.079240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:37.188356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:37.199995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:37.199995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:37.207723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-38f4c7ba-89f6-4b94-baf1-7ebf07838ae8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.197983 May 12 17:16:37.208343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 50/108] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:37 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:37.255707 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:37.264158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8cc3a86f-a1a9-46d3-bd88-c99c0508b3f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.197330 May 12 17:16:37.264731 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 59/109] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:37 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:37.277592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:37.278468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:37.285406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:37.286127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:37.290161 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:37.290643 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:37.428955 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:37.436131 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bb61ee52-553e-41f0-a2c1-1a2cf178beb6 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.162988 May 12 17:16:37.436696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 51/110] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:37 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:37.994711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-b685a944-a254-451b-b1ac-c028433d883e req-5e7a66a5-d8e0-461f-9552-4ffacc0c0f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c5e2e9-90b0-49d3-a43a-4ab2e6346af2", "name": "network-vif-plugged", "status": "completed", "tag": "c3f98d92-aa4f-4644-b6e9-33c2db6e68f7"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:38.003578 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b685a944-a254-451b-b1ac-c028433d883e req-5e7a66a5-d8e0-461f-9552-4ffacc0c0f0f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.004018 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b685a944-a254-451b-b1ac-c028433d883e req-5e7a66a5-d8e0-461f-9552-4ffacc0c0f0f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.012603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:38.013208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:38.015403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-b685a944-a254-451b-b1ac-c028433d883e req-5e7a66a5-d8e0-461f-9552-4ffacc0c0f0f service nova] Creating event network-vif-plugged:c3f98d92-aa4f-4644-b6e9-33c2db6e68f7 for instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 on hv-cinder-84159 May 12 17:16:38.019122 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.020512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.021468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.021648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-b685a944-a254-451b-b1ac-c028433d883e req-5e7a66a5-d8e0-461f-9552-4ffacc0c0f0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140921 May 12 17:16:38.021976 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.022354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 60/111] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:38.227229 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:38.228242 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:38.235431 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.235847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.236568 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.236998 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.360827 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:38.369332 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-263bbfbc-0b17-43aa-b0d5-36b57214d8ca tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.360590 May 12 17:16:38.369912 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 52/112] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:38 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:38.374308 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:38.374946 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:38.380387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:38.381720 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.382446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.383224 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.383869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.389808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:38.391452 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:38.392846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-44b5f049-b8c8-4e59-8bbb-6b0ac64115c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.170070 May 12 17:16:38.394515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 61/113] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:38 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:16:38.452856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:38.453797 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:38.462768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.463395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.464179 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:38.465324 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:38.514915 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:38.534692 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0e61774a-16de-4fd2-8d24-b8d6adb0a9ef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.163648 May 12 17:16:38.536499 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 53/114] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:38 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:38.686120 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:38.693765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-96c40337-b91d-406c-9df2-532b9ab9b0fc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.244594 May 12 17:16:38.694244 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 62/115] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:38 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:39.387353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:39.388212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:39.397071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.397856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.398788 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.399494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.411859 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:39.414520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:39.423582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.424576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.426619 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.427216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.586235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:39.594235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0e905f86-ae44-4cd5-9d99-3809304d2f9d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.212324 May 12 17:16:39.594847 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 54/116] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:39 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:39.599261 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:39.599861 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:39.606233 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.606707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.607485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.607987 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.674949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:39.686357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:39.688349 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:39.694143 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b8a65cb1-66d5-459d-b573-60f2a7406041 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.286442 May 12 17:16:39.705684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 63/117] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:39 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:39.712891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:39.713323 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:39.725624 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.726073 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.727426 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.728985 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.781967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:39.791021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3f85210d-ebf5-41c6-bebc-b2a32e817775 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.195114 May 12 17:16:39.791604 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 55/118] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:39 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:39.904996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:39.912972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8ef37483-e70e-4f08-b99f-4ec26933c91d tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.204424 May 12 17:16:39.913556 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 64/119] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:39 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:39.955884 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-e6417b91-14b1-48f5-9631-8c3e14af1248 req-1148018c-9abd-433b-9d62-be6aca3aa94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878603bd-9524-4a76-88c3-463a2f09910f", "tag": "b977622b-d460-4133-b674-446f064230f1"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:39.966345 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-e6417b91-14b1-48f5-9631-8c3e14af1248 req-1148018c-9abd-433b-9d62-be6aca3aa94d service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:39.966808 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-e6417b91-14b1-48f5-9631-8c3e14af1248 req-1148018c-9abd-433b-9d62-be6aca3aa94d service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:39.979673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-e6417b91-14b1-48f5-9631-8c3e14af1248 req-1148018c-9abd-433b-9d62-be6aca3aa94d service nova] Creating event network-changed:b977622b-d460-4133-b674-446f064230f1 for instance 878603bd-9524-4a76-88c3-463a2f09910f on hv-cinder-84159 May 12 17:16:39.985845 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-e6417b91-14b1-48f5-9631-8c3e14af1248 req-1148018c-9abd-433b-9d62-be6aca3aa94d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106998 May 12 17:16:39.986456 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 56/120] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:40.612285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:40.612926 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:40.627781 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.627781 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.627781 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.627781 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.716097 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:40.717388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:40.723595 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.724041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.724995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.725423 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.757894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:40.765732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-56147317-6f36-489d-b821-e2b78c220c85 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.157492 May 12 17:16:40.766915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 65/121] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:40 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:40.809828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:40.810902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:40.819000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.819591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.820359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.820978 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.882484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:40.891636 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:40.893798 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:40.895118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d5c112ef-0058-49d7-be56-7114b39d77f0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.183649 May 12 17:16:40.895692 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 57/122] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:40 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:40.931050 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:40.931720 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:40.940546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.941068 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:40.942646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:40.943375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:41.004066 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:41.015400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-14d247ca-f7f2-4a63-97f8-4a6f905f6dc9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.209526 May 12 17:16:41.015994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 66/123] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:40 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:41.585615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:41.595888 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9ef5a602-2324-465a-aad1-83e836f7afbc tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.668998 May 12 17:16:41.597127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 58/124] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:40 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:41.783299 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:41.784624 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:41.800029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:41.802536 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:41.805026 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:41.805755 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:41.912924 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:41.913521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:41.927239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:41.929128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:41.929980 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:41.930399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:42.044197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:42.055866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-142af260-1788-470b-b4a7-6802f693de59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.277060 May 12 17:16:42.063210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 67/125] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:41 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:42.076443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:42.078060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:42.085893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:42.087431 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:42.088434 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:42.089016 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:42.262555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:42.273416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:42.275002 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:42.282944 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-51cfd3c5-99b1-4906-9955-7fd228ff2f20 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.373584 May 12 17:16:42.283802 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 59/126] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:41 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:16:42.394334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:42.408955 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ead1713b-f09f-4ff0-a8bc-ef0683ebe925 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.342460 May 12 17:16:42.410506 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 68/127] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:42 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:42.612902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:42.613501 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:42.619387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:42.619831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:42.620616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:42.621048 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:42.784741 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:42.793768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-dfa8cf12-f2cd-4b18-ad97-a2b13d1cef74 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.184609 May 12 17:16:42.796792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 60/128] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:42 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:43.079426 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:43.080039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:43.088246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.088964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.089933 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.090878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.280774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:43.290110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e8f5486b-a1da-408c-a69d-c5bff26c1dde tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.214634 May 12 17:16:43.291417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 69/129] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:43 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:43.305558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:43.307009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:43.318104 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.318583 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.319356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.319785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.434823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:43.435787 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:43.450929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.451597 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.452555 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.453718 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.540156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:43.573922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:43.581643 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:43.585597 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4b6d51b0-14dc-4ae9-b1c4-f2d9fd7de061 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.283864 May 12 17:16:43.592825 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 61/130] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:43 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:43.742449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:43.752434 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-166e830a-0cdc-4df1-a2bf-3d07eff5cf7f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.327810 May 12 17:16:43.754534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 70/131] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:43 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:43.815737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:43.815737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:43.825754 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.826211 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:43.827049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:43.827519 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.047127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:44.055810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ce8f37c9-723c-41ae-a141-b102a8ee0203 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.248862 May 12 17:16:44.056289 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 62/132] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:43 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:44.307520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:44.308714 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:44.314822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:44.315346 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.316359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:44.316989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.457553 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:44.466484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-03d23129-7212-485c-9b24-482a3873b4ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.162654 May 12 17:16:44.468778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 71/133] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:44 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:44.609358 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:44.609962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:44.615977 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:44.616429 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.617186 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:44.617611 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.765235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:44.771332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:44.771788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:44.776549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:44.779334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:44.780818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3e944950-c014-4290-b7f6-b78003e7a8c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.175894 May 12 17:16:44.781566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 63/134] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:44 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:44.805417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:44.805866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.806668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:44.807098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:44.971627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:44.978886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8b2e3236-35da-49f0-8284-cd7d0fd14ca2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.211783 May 12 17:16:44.979553 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 72/135] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:44 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:45.073343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:45.074902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:45.082230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:45.082707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:45.083512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:45.083963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:45.228700 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:45.238371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a5feb769-74bd-45d3-9821-a139ba2598a1 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.169659 May 12 17:16:45.239948 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 64/136] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:45 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:45.501442 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:45.502906 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:45.511977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:45.512656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:45.513788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:45.514360 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:45.727929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:45.736007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a7d2fc1f-20cb-4ffc-b7b0-131b26ecbb49 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.253731 May 12 17:16:45.736778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 73/137] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:45 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:45.799432 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:45.800047 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:45.807095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:45.807546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:45.808895 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:45.809339 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:45.984737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:45.997071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:45.999840 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:46.000754 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:46.007993 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:46.009468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.010167 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:46.011856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.012452 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0bd9639f-2462-4a5e-9349-a34a3490e621 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.215075 May 12 17:16:46.012875 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:46.014119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 65/138] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:45 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:46.069693 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-1edb53a4-d986-4671-92cd-b0a767a08acd req-57ecc1fc-ba30-4af2-b64e-77b7395dbb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674ec2ad-d5d1-46d6-b683-b5c2bd561c9a", "name": "network-vif-plugged", "status": "completed", "tag": "d57d4a88-7f65-442d-9424-fce30450293a"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:46.086859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-1edb53a4-d986-4671-92cd-b0a767a08acd req-57ecc1fc-ba30-4af2-b64e-77b7395dbb9a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.086859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-1edb53a4-d986-4671-92cd-b0a767a08acd req-57ecc1fc-ba30-4af2-b64e-77b7395dbb9a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:46.098983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-1edb53a4-d986-4671-92cd-b0a767a08acd req-57ecc1fc-ba30-4af2-b64e-77b7395dbb9a service nova] Creating event network-vif-plugged:d57d4a88-7f65-442d-9424-fce30450293a for instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a on hv-cinder-84159 May 12 17:16:46.104602 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-1edb53a4-d986-4671-92cd-b0a767a08acd req-57ecc1fc-ba30-4af2-b64e-77b7395dbb9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041112 May 12 17:16:46.106247 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 66/139] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:46.253899 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:46.257865 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:46.258595 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:46.264196 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bba885b6-c79a-4ee5-bb21-551f88f59105 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.271904 May 12 17:16:46.265163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 74/140] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:45 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:46.265585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.266175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:46.267027 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.267462 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:46.413365 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:46.421267 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6de585fe-65b8-4144-ac93-c50055c09899 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1315 microversion: 2.1 time: 0.168318 May 12 17:16:46.421841 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 67/141] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:46 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:46.754819 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:46.755757 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:46.769680 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.770997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:46.772134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:46.772721 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.032062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:47.033276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:47.039650 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:47.040258 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.041397 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:47.042694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.231019 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:47.241750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:47.242237 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:47.244160 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:47.246139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-dc0aa414-d7ef-40af-a615-a8066d6e2086 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.217295 May 12 17:16:47.246992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 68/142] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:47 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:16:47.251288 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0391b271-4d16-44b0-aec0-4e411e3a9974 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.502297 May 12 17:16:47.253770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 75/143] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:46 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:47.285694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:47.286240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:47.295590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:47.296409 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.297474 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:47.298159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.437458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:47.438263 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:47.448703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:47.450593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.452984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:47.454293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:47.578017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:47.589984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-06a3268d-d6d8-409c-8604-41ac063626b3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.311961 May 12 17:16:47.599614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 69/144] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:47 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:47.661991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:47.671685 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-baad3e8d-5ddf-4c1b-a7fd-887b79cd3e9e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1501 microversion: 2.1 time: 0.238540 May 12 17:16:47.672808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 76/145] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:47 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:48.160314 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-c3861aa7-7e7f-4419-a1ee-be4c86bf373f req-a48ced9c-bcdc-4dda-90f1-5141df853971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fea2bf-d6a6-4a97-be8f-bd754b36e60c", "name": "network-vif-plugged", "status": "completed", "tag": "4b14ecbe-91e8-4995-96ec-24bef4c83422"}, {"server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "name": "network-vif-plugged", "status": "completed", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:48.169869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-c3861aa7-7e7f-4419-a1ee-be4c86bf373f req-a48ced9c-bcdc-4dda-90f1-5141df853971 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.170304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-c3861aa7-7e7f-4419-a1ee-be4c86bf373f req-a48ced9c-bcdc-4dda-90f1-5141df853971 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.183269 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-c3861aa7-7e7f-4419-a1ee-be4c86bf373f req-a48ced9c-bcdc-4dda-90f1-5141df853971 service nova] Creating event network-vif-plugged:4b14ecbe-91e8-4995-96ec-24bef4c83422 for instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c on hv-cinder-84159 May 12 17:16:48.183781 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-c3861aa7-7e7f-4419-a1ee-be4c86bf373f req-a48ced9c-bcdc-4dda-90f1-5141df853971 service nova] Creating event network-vif-plugged:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:16:48.190652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-c3861aa7-7e7f-4419-a1ee-be4c86bf373f req-a48ced9c-bcdc-4dda-90f1-5141df853971 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033932 May 12 17:16:48.191259 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 70/146] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:48.266629 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:48.267485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:48.273564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.274188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.274329 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:48.275313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.276013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:48.276144 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.288820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.289267 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.290036 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.290543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.529704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:48.540765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:48.542692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:48.544046 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b4c1e4b3-994d-4e88-851a-7d5cc454ff61 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.282742 May 12 17:16:48.555153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 77/147] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:48 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:48.575358 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:48.583273 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3cb1761c-57cd-4928-9a9d-5695b58ef412 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.314431 May 12 17:16:48.597174 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 71/148] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:48 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:48.611558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:48.612163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:48.618320 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.618789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.619557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:48.619981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:48.761691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:48.770721 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8a92e6ee-3976-443b-ab7c-076bc6dbac71 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.162726 May 12 17:16:48.771595 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 78/149] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:48 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:16:49.181549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c04915fc-b678-47f7-b46f-c3be44d1e1f4"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:49.183017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:49.206033 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:49.206825 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:49.208045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:49.213154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:49.562119 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:49.562825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:49.569014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:49.569460 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:49.570449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:49.571103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:49.762744 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:49.771094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:49.772594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:49.775234 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d7faac5f-32d8-4b49-9484-5f63a1c81b71 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.217584 May 12 17:16:49.775964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 79/150] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:49 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:49.786497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:49.787371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:49.802860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:49.803313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:49.804092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:49.804603 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:50.002794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:50.021643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5dc061d1-0283-4c0a-9c20-f975f6eae08b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.243423 May 12 17:16:50.022740 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 80/151] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:49 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:50.028417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:50.029221 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:50.036255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:50.037186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:50.038109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:50.038867 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:50.187941 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:50.196129 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0384e175-ffde-409e-93ac-b116f1b6dd79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1322 microversion: 2.1 time: 0.172024 May 12 17:16:50.196959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 81/152] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:50 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:50.774993 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b52de811-714e-4256-a910-e48dd0ee4548 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "POST /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.598139 May 12 17:16:50.775628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 72/153] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:16:49 2022] POST /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2/os-volume_attachments => generated 194 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:50.794163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:50.794815 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:50.802375 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:50.803081 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:50.804384 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:50.805030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:50.951825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:50.959465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:50.960957 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:50.962046 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a5a94c68-ad68-4c25-996b-2eeddc5dfe03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1404 microversion: 2.20 time: 0.172290 May 12 17:16:50.962633 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 82/154] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:50 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:16:51.040119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:51.040862 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:51.048575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.049016 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.049783 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.050220 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.214588 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:51.215956 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:51.229546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.231398 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.232437 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.234515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.294004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:51.302148 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c1de6518-1835-4d64-8f3b-5caa7fa1e86d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.266594 May 12 17:16:51.302962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 73/155] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:51 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:51.362387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-86e2e8b2-062f-44bd-a7de-27992fffbff8 req-291f6f44-db85-4c5c-bf5b-ac875155d7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878603bd-9524-4a76-88c3-463a2f09910f", "name": "network-vif-plugged", "status": "completed", "tag": "b977622b-d460-4133-b674-446f064230f1"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:51.377301 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-86e2e8b2-062f-44bd-a7de-27992fffbff8 req-291f6f44-db85-4c5c-bf5b-ac875155d7c8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.378157 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-86e2e8b2-062f-44bd-a7de-27992fffbff8 req-291f6f44-db85-4c5c-bf5b-ac875155d7c8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.395432 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-86e2e8b2-062f-44bd-a7de-27992fffbff8 req-291f6f44-db85-4c5c-bf5b-ac875155d7c8 service nova] Creating event network-vif-plugged:b977622b-d460-4133-b674-446f064230f1 for instance 878603bd-9524-4a76-88c3-463a2f09910f on hv-cinder-84159 May 12 17:16:51.403289 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-86e2e8b2-062f-44bd-a7de-27992fffbff8 req-291f6f44-db85-4c5c-bf5b-ac875155d7c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051554 May 12 17:16:51.404554 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 74/156] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:51.456723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:51.466150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e2295ee6-aca8-4007-bcfd-e883d091a60a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1516 microversion: 2.1 time: 0.256342 May 12 17:16:51.471480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 83/157] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:51 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:51.490752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:51.492001 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:51.498530 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.498984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.499755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.500192 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.527928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lazy-loading 'flavor' on Instance uuid 68fea2bf-d6a6-4a97-be8f-bd754b36e60c {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:16:51.643145 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bcc0fa16-8bf2-42c6-a0c1-d203932b823a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c/action" status: 200 len: 32 microversion: 2.1 time: 0.157779 May 12 17:16:51.644114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 75/158] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:16:51 2022] POST /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:16:51.653929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:51.654739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:51.661514 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.662033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.663115 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.664142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:51.812494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:51.821083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-028e831b-2113-49d2-8914-ea13a080a947 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.171552 May 12 17:16:51.821667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 84/159] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:51 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:51.983175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:51.985124 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:51.998721 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:51.999219 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.001498 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.002125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.295432 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:52.306686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:52.309128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:52.310335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a0571e35-34c4-4a96-b49a-5bf073a2bb56 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1597 microversion: 2.20 time: 0.332441 May 12 17:16:52.310948 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 76/160] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:16:51 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1597 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:16:52.319266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:52.319876 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:52.326012 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.326495 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.327263 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.327696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.330314 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:52.330930 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:52.344057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.345063 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.345978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.347200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.445064 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-997bfc60-c5d8-4310-b39e-8a08a09997f2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.119765 May 12 17:16:52.445732 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 77/161] 10.222.0.23 () {60 vars in 1315 bytes} [Thu May 12 17:16:52 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:16:52.483344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:52.492147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-996d1a35-3705-4322-98f6-f2382e7f886c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.176797 May 12 17:16:52.493052 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 85/162] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:52 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:52.841585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:52.842189 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:52.849898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.851239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:52.852347 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:52.852971 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:53.199105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:53.207045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-caebb44b-ed33-4316-bb29-7e7780c5c062 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.370146 May 12 17:16:53.208123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 78/163] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:52 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:53.509967 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:53.510696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:53.522299 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:53.522786 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:53.523684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:53.524117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:53.722619 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:53.730286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7ed2a827-b5de-48d5-b5a7-982fb680c3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1363 microversion: 2.1 time: 0.224562 May 12 17:16:53.730903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 86/164] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:53 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:54.224229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:54.225349 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:54.232462 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:54.233183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:54.234430 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:54.235001 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:54.451379 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-b14dded3-6a4f-44a6-b00b-beea10ad76fa req-363fdc27-b977-48cc-aeb8-d4403795b85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:54.476457 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b14dded3-6a4f-44a6-b00b-beea10ad76fa req-363fdc27-b977-48cc-aeb8-d4403795b85f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:54.484196 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b14dded3-6a4f-44a6-b00b-beea10ad76fa req-363fdc27-b977-48cc-aeb8-d4403795b85f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:54.518759 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-b14dded3-6a4f-44a6-b00b-beea10ad76fa req-363fdc27-b977-48cc-aeb8-d4403795b85f service nova] Creating event network-changed:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:16:54.531846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-b14dded3-6a4f-44a6-b00b-beea10ad76fa req-363fdc27-b977-48cc-aeb8-d4403795b85f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087430 May 12 17:16:54.537145 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:54.551623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e3926aed-8685-409d-ad8b-796da3bf7833 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.331096 May 12 17:16:54.553992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 87/165] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:54.555672 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 79/166] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:54 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:54.749264 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:54.750564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:54.762571 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:54.763223 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:54.764224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:54.764801 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:55.027468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:55.041257 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c47cfcfb-20fe-42c8-a6dc-553b244f4dbd tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1549 microversion: 2.1 time: 0.296637 May 12 17:16:55.044667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 88/167] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:54 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1549 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:55.063821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:55.064549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:55.072630 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:55.073451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:55.074495 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:55.075366 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:55.265492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-71f6f493-eb03-4b42-a2eb-a0e58ac9a651 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206609 May 12 17:16:55.273010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 80/168] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:16:55 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:16:55.576565 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:55.591141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:55.608883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:55.618968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:55.622358 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:55.623033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:56.029313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:56.038743 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-874dda3c-4065-42a2-b09e-1e80b8852030 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.468659 May 12 17:16:56.039552 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 89/169] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:55 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:57.056955 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:57.059587 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:57.067670 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:57.068270 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:57.070183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:57.071091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:57.331387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-659f04de-da47-4db6-b093-49ee62606d84 req-d77ec694-1e25-42e4-aad9-386bb31912df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878603bd-9524-4a76-88c3-463a2f09910f", "tag": "b977622b-d460-4133-b674-446f064230f1"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:16:57.343523 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-659f04de-da47-4db6-b093-49ee62606d84 req-d77ec694-1e25-42e4-aad9-386bb31912df service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:57.343976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-659f04de-da47-4db6-b093-49ee62606d84 req-d77ec694-1e25-42e4-aad9-386bb31912df service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:57.358086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:57.368399 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-659f04de-da47-4db6-b093-49ee62606d84 req-d77ec694-1e25-42e4-aad9-386bb31912df service nova] Creating event network-changed:b977622b-d460-4133-b674-446f064230f1 for instance 878603bd-9524-4a76-88c3-463a2f09910f on hv-cinder-84159 May 12 17:16:57.373972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6b021336-5867-4c61-a1f6-481f2b33907f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.321181 May 12 17:16:57.374945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 81/170] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:57 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:57.387469 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-659f04de-da47-4db6-b093-49ee62606d84 req-d77ec694-1e25-42e4-aad9-386bb31912df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060173 May 12 17:16:57.395043 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 90/171] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:16:58.391902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:58.392592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:58.399236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:58.402287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:58.407046 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:58.408406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:58.624715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:58.636999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-427d26c4-1105-4513-a2da-c6d96e7b5b63 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.249251 May 12 17:16:58.638932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 82/172] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:58 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:16:59.664182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:16:59.665942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:16:59.674065 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:59.674796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:59.676066 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:16:59.676808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:16:59.873094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:16:59.887205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c54179d6-c30e-4954-9d72-30e12ef26a16 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.231567 May 12 17:16:59.899312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 91/173] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:16:59 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:00.622024 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:00.622573 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:00.632209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:00.632730 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:00.633591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:00.634097 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:00.663752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:17:00.759391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e3fe6ec0-49b5-417b-8816-4b3932f23ee0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 204 len: 0 microversion: 2.1 time: 0.140803 May 12 17:17:00.760043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 83/174] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:17:00 2022] DELETE /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:17:00.769830 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:00.770515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:00.777394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:00.778103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:00.779098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:00.779558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:00.916113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:00.916810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:00.924017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:00.924467 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:00.925681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:00.926111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:00.927771 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:00.936947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-98b34857-08a6-4523-b199-4838f3af3dd0 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1553 microversion: 2.1 time: 0.171893 May 12 17:17:00.937516 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 92/175] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:00 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:01.127528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:01.138219 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-26a117d1-323e-4b8a-b6c3-2f1dc5787066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.234421 May 12 17:17:01.138932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 84/176] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:00 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:01.963097 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:01.964514 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:01.972270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:01.972792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:01.973625 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:01.974283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:02.111298 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:02.118847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-75b02c9a-588a-4bcc-8fe5-629d47b4e689 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1553 microversion: 2.1 time: 0.169187 May 12 17:17:02.119462 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 93/177] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:01 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:02.157508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:02.157508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:02.164262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:02.164715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:02.165783 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:02.166213 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:02.457865 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:02.465265 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-efd7ef4c-e9f5-4f17-968c-4c6bf7091d5a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.313970 May 12 17:17:02.465816 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 85/178] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:02 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:03.138275 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:03.138952 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:03.148085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:03.148545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:03.149326 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:03.149852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:03.315390 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:03.339534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-41cb8f9a-ad11-4693-b1bf-81d3fd6add90 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1553 microversion: 2.1 time: 0.205244 May 12 17:17:03.340511 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 94/179] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:03 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:03.481046 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:03.482310 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:03.489021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:03.490249 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:03.491235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:03.491732 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:03.758673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:03.770075 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5e55d365-7ece-4357-9c3c-8e86a5dbceb3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.292775 May 12 17:17:03.770735 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 86/180] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:03 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:04.233152 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-10fe86fa-9332-4729-805d-bde727202e92 req-387d0f7b-a9e0-4f6d-a7f8-fd55d7afc0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c5e2e9-90b0-49d3-a43a-4ab2e6346af2", "name": "network-vif-deleted", "tag": "c3f98d92-aa4f-4644-b6e9-33c2db6e68f7"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:04.241675 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-10fe86fa-9332-4729-805d-bde727202e92 req-387d0f7b-a9e0-4f6d-a7f8-fd55d7afc0d8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:04.242483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-10fe86fa-9332-4729-805d-bde727202e92 req-387d0f7b-a9e0-4f6d-a7f8-fd55d7afc0d8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:04.255530 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-10fe86fa-9332-4729-805d-bde727202e92 req-387d0f7b-a9e0-4f6d-a7f8-fd55d7afc0d8 service nova] Creating event network-vif-deleted:c3f98d92-aa4f-4644-b6e9-33c2db6e68f7 for instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 on hv-cinder-84159 May 12 17:17:04.261652 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-10fe86fa-9332-4729-805d-bde727202e92 req-387d0f7b-a9e0-4f6d-a7f8-fd55d7afc0d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 May 12 17:17:04.262331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 95/181] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:17:04.356716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:04.357235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:04.363108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:04.363559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:04.364321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:04.364755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:04.425477 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9825c4125b9743bc9e4a6e9ac8a4cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b4bff5a47542c589d67a522647608c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:04.433704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8c01e31b-50da-4f36-967b-60f1e5b03275 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 200 len: 1346 microversion: 2.1 time: 0.081398 May 12 17:17:04.434268 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 87/182] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:04 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:04.789512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:04.790064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:04.799343 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:04.799789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:04.800558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:04.800992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:04.979254 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:04.987171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-01d81ebd-9b6f-4cba-a729-1862b32361c7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.203438 May 12 17:17:04.987829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 96/183] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:04 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:05.450955 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:05.451573 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:05.459062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:05.459585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:05.460482 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:05.461227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:05.476775 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] HTTP exception thrown: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Request method failure captured: May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 HTTP/1.1 May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDQwxdOTS1glvMwjqOE18_j35rGryifbxsHz56TUyO__ZOBX4ozkEfYdEEiOIh2bjAm9KcyNy69BvjiIasXa5NagIZUd-VsgCvu6YGSg4t7SkYAq_3cVVxc7aP_b7QbLVjmhEfATmE9OrpZIsScWl907pdf9fNklzySd-IMf8KoU5s May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:17:05.481360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48b4bff5a47542c589d67a522647608c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48b4bff5a47542c589d67a522647608c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-DeleteServersTestJSON-168658143 May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 9825c4125b9743bc9e4a6e9ac8a4cfac May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.482621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '88c5e2e9-90b0-49d3-a43a-4ab2e6346af2'} May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:17:05.483294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.484434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:05.486034 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Returning 404 to user: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:17:05.486034 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bdd0330e-ba2f-46e8-adf9-36032b670e91 tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 404 len: 111 microversion: 2.1 time: 0.036527 May 12 17:17:05.486034 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 88/184] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:05 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:17:05.591871 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:05.592763 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:05.598885 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:05.599376 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:05.600342 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:05.600768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:05.646944 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] HTTP exception thrown: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Request method failure captured: May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2/os-volume_attachments HTTP/1.1 May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDQwxdOTS1glvMwjqOE18_j35rGryifbxsHz56TUyO__ZOBX4ozkEfYdEEiOIh2bjAm9KcyNy69BvjiIasXa5NagIZUd-VsgCvu6YGSg4t7SkYAq_3cVVxc7aP_b7QbLVjmhEfATmE9OrpZIsScWl907pdf9fNklzySd-IMf8KoU5s May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:17:05.651499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48b4bff5a47542c589d67a522647608c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48b4bff5a47542c589d67a522647608c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-DeleteServersTestJSON-168658143 May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 9825c4125b9743bc9e4a6e9ac8a4cfac May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.652939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'server_id': '88c5e2e9-90b0-49d3-a43a-4ab2e6346af2'} May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:17:05.653590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:05.655055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:05.656093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Returning 404 to user: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:17:05.656093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2f4fd534-b60d-436a-b2a8-66de4426115b tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065426 May 12 17:17:05.656093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 97/185] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:17:05 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:17:06.005329 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:06.006215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:06.013760 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:06.014519 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:06.015546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:06.016221 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:06.186468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:06.203850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a7791539-7e83-4329-8602-da56be045f0f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.203723 May 12 17:17:06.204771 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 89/186] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:05 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:06.874946 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:06.876555 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:06.883919 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:06.884606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:06.885378 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:06.886373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:06.901927 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] HTTP exception thrown: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Request method failure captured: May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 HTTP/1.1 May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDQwxdOTS1glvMwjqOE18_j35rGryifbxsHz56TUyO__ZOBX4ozkEfYdEEiOIh2bjAm9KcyNy69BvjiIasXa5NagIZUd-VsgCvu6YGSg4t7SkYAq_3cVVxc7aP_b7QbLVjmhEfATmE9OrpZIsScWl907pdf9fNklzySd-IMf8KoU5s May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:17:06.904117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48b4bff5a47542c589d67a522647608c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48b4bff5a47542c589d67a522647608c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-DeleteServersTestJSON-168658143 May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 9825c4125b9743bc9e4a6e9ac8a4cfac May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.905584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '88c5e2e9-90b0-49d3-a43a-4ab2e6346af2'} May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:17:06.906306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.907688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:06.908992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Returning 404 to user: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:17:06.908992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f079622b-05d0-43b2-a75a-fac5bf44f14e tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 404 len: 111 microversion: 2.1 time: 0.043409 May 12 17:17:06.908992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 98/187] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:17:06 2022] DELETE /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:17:06.914322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:06.915030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] [instance: 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:06.921454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:06.921900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:06.922691 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:06.923121 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:06.937665 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] HTTP exception thrown: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Request method failure captured: May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 HTTP/1.1 May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDQwxdOTS1glvMwjqOE18_j35rGryifbxsHz56TUyO__ZOBX4ozkEfYdEEiOIh2bjAm9KcyNy69BvjiIasXa5NagIZUd-VsgCvu6YGSg4t7SkYAq_3cVVxc7aP_b7QbLVjmhEfATmE9OrpZIsScWl907pdf9fNklzySd-IMf8KoU5s May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:17:06.939355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/48b4bff5a47542c589d67a522647608c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_48b4bff5a47542c589d67a522647608c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/48b4bff5a47542c589d67a522647608c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-DeleteServersTestJSON-168658143 May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 48b4bff5a47542c589d67a522647608c May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-DeleteServersTestJSON-168658143 May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 9825c4125b9743bc9e4a6e9ac8a4cfac May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-DeleteServersTestJSON-168658143-project May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.940702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '88c5e2e9-90b0-49d3-a43a-4ab2e6346af2'} May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:17:06.941484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. May 12 17:17:06.942589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:17:06.943574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] Returning 404 to user: Instance 88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:17:06.943574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f06b9406-1564-4b36-9ce6-74da434f087a tempest-DeleteServersTestJSON-168658143 tempest-DeleteServersTestJSON-168658143-project] 10.222.0.23 "GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2" status: 404 len: 111 microversion: 2.1 time: 0.030404 May 12 17:17:06.943574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 90/188] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:06 2022] GET /compute/v2.1/servers/88c5e2e9-90b0-49d3-a43a-4ab2e6346af2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:17:07.225733 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:07.226854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:07.235594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:07.236259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:07.237234 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:07.238048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:07.435867 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:07.453548 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-87dd7411-a04a-4594-8398-6306cdb4d48e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.235623 May 12 17:17:07.454124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 99/189] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:07 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:08.471206 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:08.472430 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:08.479629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:08.480423 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:08.482402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:08.483104 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:08.656594 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:08.664555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1ff23ff3-15fb-46cb-88a0-08f218a2c1d6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.197686 May 12 17:17:08.665205 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 91/190] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:08 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:09.682033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:09.682633 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:09.689020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:09.689688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:09.690837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:09.691494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:09.852547 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:09.860748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8228cabc-f37a-4e34-8140-e8bf03578c5f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.183361 May 12 17:17:09.861325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 100/191] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:09 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:10.876853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:10.877452 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:10.884033 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:10.884485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:10.885239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:10.886169 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:11.011644 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:11.018809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-71000370-7708-4fda-802a-0d97b22d76e4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.145736 May 12 17:17:11.019353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 92/192] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:10 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:12.038090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:12.038625 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:12.045361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:12.045895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:12.046739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:12.047172 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:12.204480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:12.211827 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b80191ac-41f6-4021-879a-1ba367ce9bc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.178830 May 12 17:17:12.222155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 101/193] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:12 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:13.229769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:13.230405 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:13.236921 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:13.237553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:13.238316 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:13.238766 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:13.375165 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:13.383711 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4d9bed14-1fee-4934-b142-6d7141d28ca3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.158602 May 12 17:17:13.384514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 93/194] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:13 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:14.405311 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:14.406604 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:14.412938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:14.413389 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:14.414175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:14.414636 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:14.569690 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:14.578175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-857d2eed-0fcf-4f93-8b74-6fd7c0cc84df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.177595 May 12 17:17:14.589273 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 102/195] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:14 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:15.595108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:15.595724 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:15.601916 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:15.602370 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:15.608277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:15.608942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:15.832393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:15.842514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6fa716fd-bf34-4f37-8a3c-da9f3bcc6143 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.250452 May 12 17:17:15.843105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 94/196] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:15 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:16.864268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:16.865785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:16.876868 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:16.878505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:16.880486 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:16.881137 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:17.112680 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:17.125905 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e166d711-4563-4928-9ef3-f1c1eddb779b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.262932 May 12 17:17:17.136997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 103/197] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:16 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:18.146276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:18.150038 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:18.164781 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:18.169259 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:18.171829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:18.172370 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:18.508093 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:18.519679 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5ac0c7d3-06d7-4866-a660-402a7f8be510 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.379287 May 12 17:17:18.532056 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 95/198] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:18 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:19.548314 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:19.549945 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:19.612564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:19.613347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:19.614888 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:19.615562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:19.953863 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:19.978202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ad206665-aab8-4bc7-ad37-7f2f61c9791c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.435806 May 12 17:17:19.978202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 104/199] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:19 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:20.987235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:20.988370 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:21.006351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:21.007264 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:21.008741 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:21.009203 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:21.228040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-337800071", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:21.321744 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:21.340987 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] validate_networks() for None {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:17:21.359069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c5f4a31f-54ef-49fb-8262-0cee2cea23fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.375982 May 12 17:17:21.371166 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 96/200] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:20 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:21.756376 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:17:21.757694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:17:21.758831 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:17:21.759648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:17:21.760837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:17:21.774580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:21.775254 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:21.776291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:21.776942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:21.794616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Getting quotas for project 9279b3644c97494b9bd94ee9dfad96bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:17:21.798825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Getting quotas for user 4d8701feb6864413a0fcb8b2c1c2b302 and project 9279b3644c97494b9bd94ee9dfad96bb. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:17:21.811296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:17:21.813808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:17:21.865209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c1e23ba5-07b9-481d-bcd3-7ae5178db113 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641478 May 12 17:17:21.866664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 105/201] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:17:21.881024 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-747b7523-cf63-4135-9c46-ea1984735be1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:21.882414 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-747b7523-cf63-4135-9c46-ea1984735be1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:21.979773 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-747b7523-cf63-4135-9c46-ea1984735be1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:21.998905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-747b7523-cf63-4135-9c46-ea1984735be1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1214 microversion: 2.1 time: 0.111944 May 12 17:17:21.998905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 97/202] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:21 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:22.376437 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:22.376892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:22.395310 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:22.395896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:22.399147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:22.400934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:22.716277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:22.732619 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e146fd66-f425-498f-8272-26e10752232b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.356750 May 12 17:17:22.758523 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 106/203] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:22 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:23.008519 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:23.009457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:23.027760 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:23.029037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:23.030230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:23.034709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:23.104922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:23.112690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-30126ec4-5085-445c-9c60-936d17b0ea85 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1266 microversion: 2.1 time: 0.111434 May 12 17:17:23.114457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 98/204] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:22 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:23.767959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:23.768576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:23.777965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:23.778441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:23.779214 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:23.779769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:24.132827 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:24.135753 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:24.147456 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:24.148926 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:24.150348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:24.152371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:24.205855 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:24.217451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-dee50ec2-9a8a-40a0-aca9-a8d0211b01cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.452480 May 12 17:17:24.231642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 107/205] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:23 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:24.260907 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:24.271106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-73ab75d7-9cfe-4078-b872-7d89e14dca70 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1272 microversion: 2.1 time: 0.143886 May 12 17:17:24.277695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 99/206] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:24 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:25.240608 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:25.242070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:25.252399 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:25.255135 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:25.273336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:25.278610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:25.294036 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:25.295653 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:25.302045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:25.311544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:25.312692 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:25.313255 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:25.579251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:25.586959 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1fa54904-b546-4fc1-9039-cb1b01d74a6c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.297708 May 12 17:17:25.590000 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 100/207] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:25 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:25.610081 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:25.621472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-53e11d6b-f08c-4950-8f99-f458bcb47dbd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.386982 May 12 17:17:25.633286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 108/208] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:25 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:26.605415 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:26.606093 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:26.620964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:26.621406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:26.622381 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:26.622977 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:26.640805 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:26.641546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:26.648862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:26.652711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:26.653656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:26.655893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:27.008714 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:27.015977 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8ce030b3-661a-42ec-ac41-6a96a01e2961 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.414827 May 12 17:17:27.016545 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 101/209] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:26 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:27.072325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:27.087565 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-39fe2aa5-47a3-4cd1-9780-56b6f387bae9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.452448 May 12 17:17:27.101337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 109/210] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:26 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:28.032471 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:28.036125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:28.048305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:28.048759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:28.049722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:28.050436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:28.109184 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:28.109692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:28.122062 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:28.123537 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:28.126943 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:28.128075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:29.163174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:29.183959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-cf30738e-252a-4539-8704-e6c68e3912bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 1.079921 May 12 17:17:29.198990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 110/211] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:28 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:29.270889 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:29.281913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c153848c-81e0-449a-898c-2c438d0a67b9 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 1.253136 May 12 17:17:29.284684 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 102/212] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:28 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:29.999706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-aa0d89b6-6735-4ed5-8807-d7fab6b4a644 req-63d24b4c-c6df-42da-8cac-f4a5a58a8c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6641477-2b70-408b-b3cf-ba02cb150cfd", "tag": "f5d48667-1163-4c45-bef1-259516ae72a1"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:30.024247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-aa0d89b6-6735-4ed5-8807-d7fab6b4a644 req-63d24b4c-c6df-42da-8cac-f4a5a58a8c5b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:30.028286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-aa0d89b6-6735-4ed5-8807-d7fab6b4a644 req-63d24b4c-c6df-42da-8cac-f4a5a58a8c5b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:30.060679 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-aa0d89b6-6735-4ed5-8807-d7fab6b4a644 req-63d24b4c-c6df-42da-8cac-f4a5a58a8c5b service nova] Creating event network-changed:f5d48667-1163-4c45-bef1-259516ae72a1 for instance f6641477-2b70-408b-b3cf-ba02cb150cfd on hv-cinder-84159 May 12 17:17:30.083148 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-aa0d89b6-6735-4ed5-8807-d7fab6b4a644 req-63d24b4c-c6df-42da-8cac-f4a5a58a8c5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091197 May 12 17:17:30.084430 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 111/213] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 12 17:17:30.203614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:30.204928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:30.232435 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:30.236597 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:30.237782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:30.238547 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:30.306122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:30.309813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:30.326338 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:30.330669 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:30.331923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:30.333619 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:30.743127 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:30.766049 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-433acaed-2115-46e2-b6db-bd1b5690ff16 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.467798 May 12 17:17:30.769796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 112/214] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:30 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:30.896617 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:30.910531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-614b9fe1-49fd-480c-b7b5-a99adab5dae1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.711284 May 12 17:17:30.914796 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 103/215] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:30 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:31.784580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:31.785191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:31.792366 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:31.797638 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:31.798794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:31.799381 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:31.930401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:31.931088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:31.944859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:31.945640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:31.949829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:31.950523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:32.128154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:32.137939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e7deaaf8-17dc-4b3d-b4f8-5e3c0a0e7464 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.357121 May 12 17:17:32.143365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 113/216] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:31 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:32.204797 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:32.215445 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5cfb78ce-d982-4a28-adee-23c5de28f3b5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.288971 May 12 17:17:32.216020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 104/217] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:31 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:32.579679 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-38eddc9d-be0b-43d6-905a-221b5482e77e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Action: 'create', calling method: .version_select at 0x7f78aeeec9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1239243642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFCH0FmrrPLa1XgdvwI8YAVUt8AanU5A60fwy2Mgtw6soGDjuYTfWTwLAakgubK4sfFOYZdMqLQaUuVp21kYaUDUZGivzvZ4I9TJlfYSu48hE1Lnd/Ry58dHT7/IH4f2Q=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:32.610565 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-38eddc9d-be0b-43d6-905a-221b5482e77e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for project 5d002d9e79b24742b0906bc2b220d998. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:17:32.622626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-38eddc9d-be0b-43d6-905a-221b5482e77e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for user 845032b55cfa40ad9fcd8b14782483d5 and project 5d002d9e79b24742b0906bc2b220d998. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:17:32.671821 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-38eddc9d-be0b-43d6-905a-221b5482e77e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.304624 May 12 17:17:32.673684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 114/218] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:17:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:17:33.160154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:33.160694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:33.169637 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:33.170079 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:33.170880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:33.171300 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:33.234956 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:33.235399 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:33.243262 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:33.243676 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:33.245253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:33.245881 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:33.455952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:33.465758 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:33.474686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-521fd808-4e90-44a2-adb3-187bcd973519 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.245831 May 12 17:17:33.481321 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 115/219] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:33 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:33.481590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6c3c439a-1ff4-4472-916e-645ddf29488b tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.316001 May 12 17:17:33.481590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 105/220] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:33 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:34.492017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:34.492618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:34.499566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:34.500723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:34.512152 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:34.512885 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:34.513273 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:34.513716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:34.514680 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:34.515103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:34.519838 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:34.520459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:34.766911 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:34.779880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-baa32c08-3e28-4f19-804b-bed573a88a4c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.283945 May 12 17:17:34.780478 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 106/221] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:34 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:34.809154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:34.817113 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-688cfebc-6dc1-430b-97b3-d47ce07bad6b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.328772 May 12 17:17:34.821060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 116/222] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:34 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:35.809196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:35.810503 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:35.840155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:35.841071 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:35.841533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:35.842523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:35.844148 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:35.847425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:35.858656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:35.870975 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:35.874474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:35.875192 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:36.176012 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:36.202814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ef50bdbd-f205-4bd4-a37c-3a2eede94a7a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.368240 May 12 17:17:36.213898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 117/223] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:35 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:36.255425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:36.269632 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1088a6a3-b002-434a-b801-8d588a322872 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.475806 May 12 17:17:36.280778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 107/224] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:35 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:37.224109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:37.225049 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:37.239123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:37.239750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:37.245002 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:37.245876 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:37.288769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:37.289457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:37.321758 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:37.338787 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:37.339990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:37.340634 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:37.535331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:37.558219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-434ffe2c-6573-4b7b-bba8-c032a26ec3c4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1522 microversion: 2.1 time: 0.341791 May 12 17:17:37.560913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 118/225] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:37 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:37.614223 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:37.663054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-012d5892-e6f2-484d-b1f6-35d1a99d6431 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.378381 May 12 17:17:37.664234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 108/226] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:37 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:38.577869 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:38.579138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:38.585246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:38.585804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:38.586863 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:38.587515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:38.681117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:38.681883 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:38.692781 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:38.694763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:38.695655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:38.696641 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:38.820452 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:38.828112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-93427324-54a7-4b61-abc8-84cc762bbee2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1502 microversion: 2.1 time: 0.254523 May 12 17:17:38.828687 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 119/227] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:38 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:38.845933 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:38.846890 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:38.854459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:38.854944 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:38.855725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:38.856153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:39.094539 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:39.102612 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-869c1da3-5d55-44d6-b7ec-e904e366760d tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.425949 May 12 17:17:39.109463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 109/228] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:38 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:39.119832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:39.140382 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c8bbf4a2-c718-4e3b-ad90-3eba33ea5be5 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1516 microversion: 2.1 time: 0.298481 May 12 17:17:39.141667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 120/229] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:38 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:40.128208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:40.129566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:40.138249 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:40.140505 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:40.141528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:40.142230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:40.486984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:40.499477 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c9242966-7463-4dcd-853c-b3f5c03dba77 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.377177 May 12 17:17:40.514690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 110/230] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:40 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:40.666078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-cbf027c4-6961-4676-805b-ac9aff0462c9 req-48e00365-416d-430d-8949-ba842a4f6e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6641477-2b70-408b-b3cf-ba02cb150cfd", "name": "network-vif-plugged", "status": "completed", "tag": "f5d48667-1163-4c45-bef1-259516ae72a1"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:40.685287 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-cbf027c4-6961-4676-805b-ac9aff0462c9 req-48e00365-416d-430d-8949-ba842a4f6e7e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:40.691626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-cbf027c4-6961-4676-805b-ac9aff0462c9 req-48e00365-416d-430d-8949-ba842a4f6e7e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:40.717437 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-cbf027c4-6961-4676-805b-ac9aff0462c9 req-48e00365-416d-430d-8949-ba842a4f6e7e service nova] Creating event network-vif-plugged:f5d48667-1163-4c45-bef1-259516ae72a1 for instance f6641477-2b70-408b-b3cf-ba02cb150cfd on hv-cinder-84159 May 12 17:17:40.726211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-cbf027c4-6961-4676-805b-ac9aff0462c9 req-48e00365-416d-430d-8949-ba842a4f6e7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063287 May 12 17:17:40.728070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 121/231] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:17:40.773021 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:40.774037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:40.788872 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:40.797714 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:40.798879 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:40.799344 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:40.859975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lazy-loading 'flavor' on Instance uuid 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:17:40.990775 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6b807db5-5b7f-4a05-9c94-9762f8fa07bc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/action" status: 200 len: 32 microversion: 2.1 time: 0.234904 May 12 17:17:40.992669 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 111/232] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:17:40 2022] POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/action => generated 32 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:17:41.003692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:41.004657 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:41.023015 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:41.024141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:41.026402 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:41.026922 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:41.364429 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:41.372664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-99a55c79-91e1-4002-be5b-584770bc2840 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.374853 May 12 17:17:41.373253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 122/233] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:40 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:41.520891 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:41.527212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:41.537852 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:41.547014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:41.547899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:41.553356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:41.883140 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:41.896719 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a027e7ff-3d0e-4f6a-9389-c0332a59b46e tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.383535 May 12 17:17:41.901153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 112/234] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:41 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:42.390872 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:42.391720 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:42.401804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:42.402851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:42.408838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:42.409939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:42.924690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:42.925319 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:42.940871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:42.943401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:42.944435 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:42.948071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:43.052878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:43.061928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ead85ecf-f9b0-4818-9115-8aa0d43597ac tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.674860 May 12 17:17:43.091389 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 123/235] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:42 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:43.315014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:43.326242 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-85d7a1b0-acbd-4d93-aac3-c94225ebda86 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1314 microversion: 2.1 time: 0.412918 May 12 17:17:43.327634 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 113/236] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:42 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:44.095336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:44.097358 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:44.117013 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.118037 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.119784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.120548 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.334733 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:44.344244 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:44.344904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bc6eeb4d-910f-42a3-8aec-6e989056d1cb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.254476 May 12 17:17:44.346929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 124/237] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:44 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:44.347963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:44.367166 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.370694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.371694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.372309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.573019 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:44.580335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5b317d59-f8af-41c7-9391-71552e3d4a75 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1463 microversion: 2.1 time: 0.240917 May 12 17:17:44.581221 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 114/238] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:44 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1463 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:44.590991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3720955a-3ef1-493b-9a0a-6314aec0f919 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Action: 'create', calling method: .version_select at 0x7f78aef32ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-713223441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8O46d7koK8SlbToJ7R8x58Bk4SOREPBu9ansFwRhXwM7eodSj8Dos98Nv1cnixBds0Sh4Zu3DL9MGbcmReFRvhIEOJ5GwyjM3nT7NrOARf7PM0TFb1LFxhTUCMj9hoFA=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:44.607609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-3720955a-3ef1-493b-9a0a-6314aec0f919 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Getting quotas for project 3127460c8042473294d90b9a3338a273. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:17:44.611832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-3720955a-3ef1-493b-9a0a-6314aec0f919 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Getting quotas for user 918a2e8acb8449dcbc3c137f3452d51b and project 3127460c8042473294d90b9a3338a273. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:17:44.625113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:44.625638 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:44.635633 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.636206 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.637044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.637506 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.666478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3720955a-3ef1-493b-9a0a-6314aec0f919 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.293813 May 12 17:17:44.668022 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 125/239] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:17:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:17:44.682774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:17:44.797743 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-29c52af7-5437-4f8c-9c13-ab20c70f3e45 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 204 len: 0 microversion: 2.1 time: 0.176364 May 12 17:17:44.799022 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 115/240] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:17:44 2022] DELETE /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:17:44.813343 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:44.813965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:44.819977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.820435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.821215 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:44.821775 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:44.995366 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:45.003863 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-91126bf4-d620-4eaf-a30f-551dbbc905a1 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1469 microversion: 2.1 time: 0.200130 May 12 17:17:45.005133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 126/241] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:44 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:45.366685 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:45.367474 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:45.373641 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:45.374067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:45.374956 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:45.375430 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:45.565590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:45.574330 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c8eaa421-faa1-466c-ae02-2294e9d5ce49 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.214529 May 12 17:17:45.574943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 116/242] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:45 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:46.021654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:46.022539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:46.030227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:46.031703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:46.032989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:46.033823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:46.366000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:46.383482 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1cb4a966-19c0-4805-93de-9b3fed4721c6 tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1469 microversion: 2.1 time: 0.359248 May 12 17:17:46.393974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 127/243] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:46 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:46.591939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:46.592640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:46.604626 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:46.605089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:46.606831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:46.607274 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:46.791652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:46.799379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5bec7235-316d-494b-9d32-a761caedadbc tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.211900 May 12 17:17:46.807434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 117/244] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:46 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:47.408192 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-2baf4fe5-b675-4408-8ff0-989e49503a53 req-5c268125-6a0c-4e98-b02a-6604ae95b893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6641477-2b70-408b-b3cf-ba02cb150cfd", "name": "network-vif-deleted", "tag": "f5d48667-1163-4c45-bef1-259516ae72a1"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:47.411591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:47.414804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:47.418119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2baf4fe5-b675-4408-8ff0-989e49503a53 req-5c268125-6a0c-4e98-b02a-6604ae95b893 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:47.418903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2baf4fe5-b675-4408-8ff0-989e49503a53 req-5c268125-6a0c-4e98-b02a-6604ae95b893 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:47.432748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:47.433635 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:47.435831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-2baf4fe5-b675-4408-8ff0-989e49503a53 req-5c268125-6a0c-4e98-b02a-6604ae95b893 service nova] Creating event network-vif-deleted:f5d48667-1163-4c45-bef1-259516ae72a1 for instance f6641477-2b70-408b-b3cf-ba02cb150cfd on hv-cinder-84159 May 12 17:17:47.447505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:47.449175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-2baf4fe5-b675-4408-8ff0-989e49503a53 req-5c268125-6a0c-4e98-b02a-6604ae95b893 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045580 May 12 17:17:47.449813 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 118/245] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:17:47.451398 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:47.575566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d8701feb6864413a0fcb8b2c1c2b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9279b3644c97494b9bd94ee9dfad96bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:47.587318 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1b8a53b6-1f70-469e-acb4-8019e0d6bf8a tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 200 len: 1299 microversion: 2.1 time: 0.185243 May 12 17:17:47.589274 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 128/246] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:47 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:47.818303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:47.819195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:47.827792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:47.828514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:47.829886 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:47.830575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:48.015584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:48.024424 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d211d57c-b7d5-4e00-8e69-4f95911cdcef tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.210139 May 12 17:17:48.035092 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 119/247] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:47 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:48.616653 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:48.617259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] [instance: f6641477-2b70-408b-b3cf-ba02cb150cfd] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:48.624670 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:48.625121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:48.625893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:48.626323 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:48.641726 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] HTTP exception thrown: Instance f6641477-2b70-408b-b3cf-ba02cb150cfd could not be found. May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Request method failure captured: May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd HTTP/1.1 May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUEfdyPQgA-0C3Rs_SVhtZQhhwo-HCkpXuBzA2TRELd9S6c6-2jxvLnH7JPqMnB4ZOue08bcvJTUs-up7TvoVQnoS9TasuRoaS5qcF2P_tyjVnlaMw9UajhJn1T13olznVxsNbgJlVFvT_IC3d_9N84gOItJXeOiBsn6a8Nyp88NlpI May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 9279b3644c97494b9bd94ee9dfad96bb May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesNegativeTest-1689169600 May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:17:48.643449 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9279b3644c97494b9bd94ee9dfad96bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9279b3644c97494b9bd94ee9dfad96bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9279b3644c97494b9bd94ee9dfad96bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9279b3644c97494b9bd94ee9dfad96bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesNegativeTest-1689169600 May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 9279b3644c97494b9bd94ee9dfad96bb May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesNegativeTest-1689169600 May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesNegativeTest-1689169600-project May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 4d8701feb6864413a0fcb8b2c1c2b302 May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesNegativeTest-1689169600-project May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance f6641477-2b70-408b-b3cf-ba02cb150cfd could not be found. May 12 17:17:48.644938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': 'f6641477-2b70-408b-b3cf-ba02cb150cfd'} May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6641477-2b70-408b-b3cf-ba02cb150cfd could not be found. May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:17:48.652622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6641477-2b70-408b-b3cf-ba02cb150cfd could not be found. May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6641477-2b70-408b-b3cf-ba02cb150cfd could not be found. May 12 17:17:48.654345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:17:48.656206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] Returning 404 to user: Instance f6641477-2b70-408b-b3cf-ba02cb150cfd could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:17:48.656206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4bb46d41-36e4-43a8-b904-e99452c5525c tempest-VolumesNegativeTest-1689169600 tempest-VolumesNegativeTest-1689169600-project] 10.222.0.23 "GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd" status: 404 len: 111 microversion: 2.1 time: 0.032054 May 12 17:17:48.656206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 129/248] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:48 2022] GET /compute/v2.1/servers/f6641477-2b70-408b-b3cf-ba02cb150cfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:17:49.046516 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:49.047333 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:49.066876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:49.067763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:49.068624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:49.069153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:49.275581 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:49.291681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f2c83b9a-706b-4610-bca4-a2c396b395df tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.251958 May 12 17:17:49.292279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 120/249] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:49 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:50.307990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:50.308602 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:50.314913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:50.315436 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:50.316279 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:50.316748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:50.453086 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:50.460502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bc4ce570-fa79-4f7d-9209-fc3716be4407 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.156170 May 12 17:17:50.461203 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 130/250] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:50 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:50.744940 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:50.745702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:50.754541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:50.755293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:50.756150 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:50.756706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:50.785915 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a7b36e54-27ba-460a-878a-2c3d9f1b1e2e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/ips" status: 200 len: 153 microversion: 2.20 time: 0.046662 May 12 17:17:50.786696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 121/251] 10.222.0.23 () {60 vars in 1288 bytes} [Thu May 12 17:17:50 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:17:51.477126 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:51.477768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:51.486628 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:51.486628 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:51.486628 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:51.486628 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:51.627773 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:51.635411 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-12ad7372-8389-42af-96a5-927a1214cb58 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.162161 May 12 17:17:51.635951 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 131/252] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:51 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:52.652057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:52.653295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:52.659922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:52.660368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:52.661140 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:52.661573 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:52.784591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:52.794078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5f5a4a16-968d-4263-bbc3-bd1341707ce3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.145800 May 12 17:17:52.794694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 122/253] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:52 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:53.642947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:53.643504 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:53.653352 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:53.653815 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:53.654647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:53.655085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:53.684282 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lazy-loading 'flavor' on Instance uuid 47998668-5296-4019-a02c-3c80e30ff266 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:17:53.812196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:53.812818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:53.823133 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:53.823589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:53.828248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:53.828248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:54.000199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:54.007750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2484099a-ad3f-4e3e-b331-7a00634016b7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.199468 May 12 17:17:54.008303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 123/254] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:53 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:54.168064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-05e4bca4-6bfa-4d0d-aa5c-2a943ec4041f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/action" status: 202 len: 0 microversion: 2.20 time: 0.529822 May 12 17:17:54.169467 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 132/255] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 12 17:17:53 2022] POST /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:17:54.176783 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:54.177698 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:54.184192 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:54.184818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:54.185594 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:54.186033 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:54.348577 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:54.371617 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:54.373312 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:54.374512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a6d0d049-d472-4682-ab64-1b68f7af0d7a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.201582 May 12 17:17:54.375080 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 124/256] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:17:54 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:17:54.471178 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:54.472220 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:54.480475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:54.480927 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:54.481892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:54.482330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:54.515073 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-73e6a559-6d96-4a72-b410-1f27101ac80a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/ips" status: 200 len: 145 microversion: 2.1 time: 0.048322 May 12 17:17:54.516696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 133/257] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:17:54 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:17:54.767978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-366894851", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1239243642", "security_groups": [{"name": "tempest-secgroup-smoke-206222092"}], "block_device_mapping_v2": [{"uuid": "50d7da8a-7e6e-4f37-85eb-ca2068447843", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6fb55941-2cb2-4359-bdd6-587e053b44f0"}]}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:17:54.875718 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] validate_networks() for [('6fb55941-2cb2-4359-bdd6-587e053b44f0', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:17:55.025755 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:55.026334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:55.032608 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:55.033053 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:55.033831 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:55.034262 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:55.176757 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:55.185423 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bfd4b74d-2889-43b5-a270-94311a53d106 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.164097 May 12 17:17:55.186090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 134/258] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:55 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:17:55.393258 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:55.394299 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:55.400950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:55.401483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:55.402380 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:55.402873 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:55.505981 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:17:55.506400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:17:55.506910 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:17:55.507609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:17:55.508016 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:17:55.517128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:55.517572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:55.518371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:55.518834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:55.535173 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for project 5d002d9e79b24742b0906bc2b220d998. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:17:55.539078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for user 845032b55cfa40ad9fcd8b14782483d5 and project 5d002d9e79b24742b0906bc2b220d998. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:17:55.597188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:17:55.599472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50d7da8a-7e6e-4f37-85eb-ca2068447843',volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:17:55.663704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:55.673051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:55.675011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:55.676437 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7bda8c13-bc47-4eec-95a4-cc3008911a84 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.287209 May 12 17:17:55.677226 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 135/259] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:17:55 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:17:55.767451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f0172d9b-6d2d-4f96-8c9d-5933a95b280b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.003553 May 12 17:17:55.768105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 125/260] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:17:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:17:55.778021 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0f1a676c-d1b2-4b93-849c-35168dc6af66 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:55.778688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0f1a676c-d1b2-4b93-849c-35168dc6af66 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:55.931397 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0f1a676c-d1b2-4b93-849c-35168dc6af66 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:55.939948 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0f1a676c-d1b2-4b93-849c-35168dc6af66 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1094 microversion: 2.1 time: 0.165682 May 12 17:17:55.949949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 136/261] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:55 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1094 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:56.202858 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:56.203469 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:56.210028 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:56.210500 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:56.211265 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:56.211696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:56.343190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:56.350712 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4c544637-a884-431c-8951-f5bef5ddacfd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.152129 May 12 17:17:56.351348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 126/262] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:56 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:56.695397 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:56.696036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:56.707231 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:56.707856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:56.708840 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:56.709419 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:56.836509 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:56.846403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:56.848240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:56.849418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6e6a4b90-4a90-4261-ace0-6d52ef3e33ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.157967 May 12 17:17:56.849974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 137/263] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:17:56 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:17:56.957535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:56.958142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:56.964089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:56.964537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:56.965297 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:56.965729 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:57.026892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:57.033973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ab1e2dac-62fa-4e43-b04f-6d26fe1b9615 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1144 microversion: 2.1 time: 0.080393 May 12 17:17:57.034572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 127/264] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:56 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:57.367699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:57.368307 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:57.375067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:57.375521 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:57.376283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:57.376719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:57.505030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:57.512544 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8b0a652e-e258-42f6-b6ca-2b67a0789b3f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.148766 May 12 17:17:57.513110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 138/265] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:57 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:57.868587 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:57.869198 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:57.875542 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:57.875992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:57.876756 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:57.877188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:58.004181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:58.012831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:58.014343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:58.015531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-13d5c847-c1b1-4374-8fbc-a588ebd00261 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.151891 May 12 17:17:58.016091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 128/266] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:17:57 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:17:58.051086 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:58.051695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:58.057621 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:58.058071 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:58.058856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:58.059293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:58.120268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:58.127367 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-162348bb-077b-4a85-95b8-29fd0bb0f6cc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1144 microversion: 2.1 time: 0.080166 May 12 17:17:58.128090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 139/267] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:58 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:58.529740 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:58.530339 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:58.536263 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:58.536711 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:58.537476 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:58.537906 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:58.661772 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:58.669565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-161f825a-caa9-4bf1-9552-6c5d671c4a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.143860 May 12 17:17:58.670132 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 129/268] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:58 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:59.034699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:59.035601 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:59.042618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:59.043051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:59.043832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:59.044264 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:59.148187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:59.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:59.158115 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:59.158846 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:59.159973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:59.160421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:59.200819 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:59.208902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:59.210460 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:59.211616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-73f2b39d-9f32-4f20-a837-b3eaab8b0d25 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.181066 May 12 17:17:59.212424 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 140/269] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:17:59 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:17:59.245091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:59.252541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4d123e41-3346-4243-a941-970946533450 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1192 microversion: 2.1 time: 0.110856 May 12 17:17:59.253139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 130/270] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:59 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:17:59.687946 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:17:59.688756 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:17:59.694846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:59.695291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:59.696058 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:17:59.696486 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:17:59.848172 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:17:59.858039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3dc85b94-9c97-454b-955f-f47472e5ec89 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.173949 May 12 17:17:59.858900 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 141/271] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:17:59 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:00.231779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:00.232798 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:00.239108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.239832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.240604 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.241037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.274305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:00.276845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:00.311605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.314135 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.315405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.316257 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.416440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:00.424764 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:00.427651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:00.429859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:00.431616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5fba003a-2a19-4393-96c8-5590b9a396f4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.203737 May 12 17:18:00.432182 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 131/272] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:00 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:00.434134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d3891f46-12c4-4209-b538-5137a1af2b06 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1210 microversion: 2.1 time: 0.166860 May 12 17:18:00.434842 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 142/273] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:00 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1210 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:00.775263 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a28b49d4-a43f-4b2d-a98c-d7381303b62f"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:00.776451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:00.782655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.783113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.783896 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.784335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.876040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:00.876745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:00.883472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.884340 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:00.885655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:00.886269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:01.071245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0bc3b0c3-2150-41d6-b60e-ac76b589c827 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299900 May 12 17:18:01.072045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 132/274] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:18:00 2022] POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:01.088428 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:01.096122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-772021f9-09cd-48ab-8630-6c782cf14e81 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.224024 May 12 17:18:01.099067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 143/275] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:00 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:01.450080 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:01.450716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:01.450843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:01.452172 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:01.459827 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:01.460610 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:01.461443 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:01.462930 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:01.471379 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:01.471984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:01.472804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:01.473238 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:01.615200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:01.628276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:01.632380 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:01.635961 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b15dc036-3e6d-41b5-bfac-157291e7b001 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.189416 May 12 17:18:01.647929 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 133/276] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:01 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:01.692343 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:01.701113 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d12a1f0b-f442-4207-b07f-e86795fe4335 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.254888 May 12 17:18:01.702099 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 144/277] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:01 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:02.091306 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-72ef9407-69af-4519-8819-7f9289756537 req-841e9860-27ff-4288-b462-1f9d493d95e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9131b16e-e337-480c-a45b-91625a94863d", "tag": "9cb1a268-4909-4277-8a38-1bb3a04f115d"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:02.103180 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-72ef9407-69af-4519-8819-7f9289756537 req-841e9860-27ff-4288-b462-1f9d493d95e4 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.103953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-72ef9407-69af-4519-8819-7f9289756537 req-841e9860-27ff-4288-b462-1f9d493d95e4 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.117008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:02.117955 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:02.125935 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.126441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-72ef9407-69af-4519-8819-7f9289756537 req-841e9860-27ff-4288-b462-1f9d493d95e4 service nova] Creating event network-changed:9cb1a268-4909-4277-8a38-1bb3a04f115d for instance 9131b16e-e337-480c-a45b-91625a94863d on hv-cinder-84159 May 12 17:18:02.126901 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.128120 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.129655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.131725 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-72ef9407-69af-4519-8819-7f9289756537 req-841e9860-27ff-4288-b462-1f9d493d95e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044483 May 12 17:18:02.132600 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 134/278] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:02.355992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:02.363837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7179cc3b-3912-401d-93f5-10c678d61aae tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.250866 May 12 17:18:02.364496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 145/279] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:02 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:02.656146 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:02.656867 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:02.662780 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.663227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.663987 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.664423 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.720848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:02.721475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:02.728708 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.729157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.729928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:02.730361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:02.828704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:02.838091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:02.839688 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:02.841667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ee1fc000-a8df-4c22-953d-ea10e974969f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.190222 May 12 17:18:02.842728 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 135/280] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:02 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:02.914887 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:02.928277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a4782624-4fd0-41e9-a3a3-5b42b26b0bf6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.211803 May 12 17:18:02.929534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 146/281] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:02 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:03.381472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:03.382346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:03.389805 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:03.390292 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:03.391304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:03.391737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:03.530881 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:03.538250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b6310266-7087-46d4-b62f-4a257302da30 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.160968 May 12 17:18:03.538845 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 136/282] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:03 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:03.859851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:03.860448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:03.866515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:03.866963 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:03.867728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:03.868163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:03.944972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:03.946065 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:03.953428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:03.953922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:03.955078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:03.955958 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:04.002099 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:04.010305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:04.011884 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:04.013024 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d423aec0-76f7-483b-bd12-aeda19eda30a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.157068 May 12 17:18:04.013575 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 147/283] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:03 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:04.083248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:04.090483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4310b1d8-7fb8-44be-b1d8-20a8cea5260a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.149324 May 12 17:18:04.091066 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 137/284] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:03 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:04.555213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:04.558889 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:04.565698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:04.566146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:04.566978 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:04.567417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:04.706768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:04.718004 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e1730f22-c975-4924-829b-7381f774b08b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.166733 May 12 17:18:04.719087 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 148/285] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:04 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:05.031508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:05.032108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:05.038311 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:05.038811 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:05.039567 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:05.039995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:05.108911 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:05.109743 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:05.116364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:05.116815 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:05.117735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:05.118414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:05.176537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:05.186349 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:05.193678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:05.195098 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ce3250f1-d239-4d6e-9efe-3adee38dcf43 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.167526 May 12 17:18:05.195894 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 138/286] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:05 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:05.267284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:05.275365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-84e63fe2-4524-4475-8321-c246f233644f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.170591 May 12 17:18:05.276233 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 149/287] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:05 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:05.735018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:05.735629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:05.741517 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:05.741966 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:05.742757 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:05.743191 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:05.867786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:05.875695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-54db60fc-c6a2-430c-b779-0c9ede18d8bd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.144454 May 12 17:18:05.876267 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 139/288] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:05 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:06.213098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:06.213695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:06.219551 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:06.219993 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:06.220748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:06.221176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:06.292922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:06.293720 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:06.300179 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:06.300937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:06.301633 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:06.302070 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:06.359217 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:06.367247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:06.369383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:06.370574 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9795b444-d876-4b08-b8ea-6061048cf9c4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.161420 May 12 17:18:06.371142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 150/289] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:06 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:06.510558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:06.518842 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f37d8405-da43-439f-b93d-a90e5b2d50c2 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.230232 May 12 17:18:06.519755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 140/290] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:06 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:06.689804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-760276795", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-713223441", "security_groups": [{"name": "tempest-secgroup-smoke-1396268530"}], "networks": [{"uuid": "2f4b42e4-7732-4c98-9681-fbceae906075"}], "block_device_mapping_v2": [{"uuid": "6057f1ee-a5f6-49a9-8587-86cc60ac4485", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:06.863535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] validate_networks() for [('2f4b42e4-7732-4c98-9681-fbceae906075', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:18:06.892844 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:06.893526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:06.899339 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:06.899784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:06.900592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:06.901025 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.033624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:07.041502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3ae67cae-ed81-4d46-94a7-c962c7be6d79 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.152425 May 12 17:18:07.042197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:06 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:07.379549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:18:07.380064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:18:07.380450 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:18:07.380878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:18:07.381283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:18:07.389571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:07.390173 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:07.390332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:07.391004 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.391864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:07.392299 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.399286 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:07.399286 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.399286 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:07.399286 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.412876 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Getting quotas for project 3127460c8042473294d90b9a3338a273. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:18:07.418131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Getting quotas for user 918a2e8acb8449dcbc3c137f3452d51b and project 3127460c8042473294d90b9a3338a273. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:18:07.479260 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:18:07.481570 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6057f1ee-a5f6-49a9-8587-86cc60ac4485',volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:18:07.558336 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:07.566485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:07.567985 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:07.569139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4811b605-0295-4347-9bfb-53f740f5ea3c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.183776 May 12 17:18:07.570736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 142/292] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:07 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:07.576154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:07.576746 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:07.583301 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:07.583707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.584397 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:07.584843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:07.633130 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0b2a8888-6303-4c69-8b1f-34a9d3b6b4a7 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.947088 May 12 17:18:07.639744 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 151/293] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:18:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:18:07.649154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-632143ad-da18-4514-984d-84560659e7a4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:07.650343 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-632143ad-da18-4514-984d-84560659e7a4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:07.719100 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-632143ad-da18-4514-984d-84560659e7a4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:07.726555 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-632143ad-da18-4514-984d-84560659e7a4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1087 microversion: 2.1 time: 0.085421 May 12 17:18:07.727141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 152/294] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:07 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:07.782314 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:07.794017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-99de4ca3-66dc-4ff8-bd56-8854d9126940 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.221355 May 12 17:18:07.794607 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 143/295] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:07 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:08.058877 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:08.059476 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.065211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.065652 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.066401 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.066851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.225836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:08.239864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-416ee1fa-bafe-4f9a-84b0-80d27d361066 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1502 microversion: 2.1 time: 0.185290 May 12 17:18:08.240434 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:08 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:08.258681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e718d87-4dfa-414f-adbb-f024ba4e4aa4"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:08.260502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.267056 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.267511 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.268288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.268723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.292896 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] HTTP exception thrown: Cannot 'attach_volume' instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a while it is in vm_state rescued May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Request method failure captured: May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/os-volume_attachments HTTP/1.1 May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 74 May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDbaoID1mXNalGPs8Oq4EVEG_oMbHWy9gLmpb4Pe6294BkPmlutnw9PSOScsq6PPOPIXjoUUFZgcVlQ1atTPoQdAyxxYF85WY84DoMVqpHEGfysHI9EE_bwXgIrjmZvSP7RyMEHE10MiCvSKdjSibzfxkXLIoOEGnPndR3MRdt_uuA May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 638166bec22640968de80cfeaeed437b May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:18:08.294833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/638166bec22640968de80cfeaeed437b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_638166bec22640968de80cfeaeed437b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 638166bec22640968de80cfeaeed437b May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 650969502a9f41e38066a7c269d84ab7 May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {"volumeAttachment": {"volumeId": "4e718d87-4dfa-414f-adbb-f024ba4e4aa4"}} May 12 17:18:08.296334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Cannot 'attach_volume' instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a while it is in vm_state rescued May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'server_id': '674ec2ad-d5d1-46d6-b683-b5c2bd561c9a', 'body': {'volumeAttachment': {'volumeId': '4e718d87-4dfa-414f-adbb-f024ba4e4aa4'}}} May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:18:08.297235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a while it is in vm_state rescued May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:18:08.298817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a while it is in vm_state rescued May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Returning 409 to user: Cannot 'attach_volume' instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a while it is in vm_state rescued {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-db8e7e60-1073-4201-9fe8-56b9f0ded281 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043561 May 12 17:18:08.300181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 144/297] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:18:08 2022] POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 17:18:08.306606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:08.307129 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.313264 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.313787 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.314590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.315023 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.387283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c200f412-6fc1-4aa3-829d-bd794bb18a0c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.084939 May 12 17:18:08.387956 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 154/298] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:18:08 2022] POST /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:18:08.396099 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:08.396704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.403043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.403489 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.404253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.404691 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.542485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:08.549799 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8a1315af-d3d4-4e17-aac3-0018cb379dc8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1510 microversion: 2.1 time: 0.157660 May 12 17:18:08.550463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 145/299] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:08 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:08.588496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:08.589243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.595476 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.596061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.596963 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.597490 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.731008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:08.740577 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:08.742104 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:08.743433 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5db3fe0f-2628-47da-975f-81f571a00636 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.159105 May 12 17:18:08.743990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 155/300] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:08 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:08.745735 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:08.746356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.757661 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.758117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.758928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.759371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.811599 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:08.812441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:08.819986 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.823047 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.823306 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:08.824150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:08.824592 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:08.831996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5efb96db-da1e-4ebc-a06a-b25e33d5cba5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1137 microversion: 2.1 time: 0.092339 May 12 17:18:08.833119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 146/301] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:08 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:09.046185 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:09.055216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-36340c6c-c8e0-4cf5-a9b6-77630be99ba6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.247581 May 12 17:18:09.056007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 156/302] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:08 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:09.568264 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:09.568880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:09.582362 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.582819 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:09.583608 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.584040 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:09.709259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-da740359-0c1c-4859-998f-140b9047ff3e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:09.716616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-da740359-0c1c-4859-998f-140b9047ff3e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.717277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-da740359-0c1c-4859-998f-140b9047ff3e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:09.789889 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-da740359-0c1c-4859-998f-140b9047ff3e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Going to try to stop instance {{(pid=117075) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 17:18:09.857508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-da740359-0c1c-4859-998f-140b9047ff3e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action" status: 202 len: 0 microversion: 2.1 time: 0.152350 May 12 17:18:09.858884 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 157/303] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:18:09 2022] POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:18:09.873314 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:09.874975 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:09.875902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:09.882435 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9c299190-5b07-4d0a-805f-8fb4f4e8984f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1510 microversion: 2.1 time: 0.317915 May 12 17:18:09.883230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 147/304] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:09 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:09.892934 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:09.899878 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:09.900174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.902396 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:09.904446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.906118 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:09.923009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.923468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:09.924305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:09.924689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:10.059356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:10.066759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9d3265dd-a10f-4388-b5e8-ba966e1496a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1203 microversion: 2.1 time: 0.182233 May 12 17:18:10.069686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 148/305] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:09 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1203 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:10.074455 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:10.079785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:10.085923 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:10.086372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:10.087923 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:10.088354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:10.239084 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:10.248447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:10.249994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:10.251874 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8ecf4e9f-2eda-432f-b62f-5649d188152a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.391550 May 12 17:18:10.252585 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 158/306] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:09 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:10.258147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:10.259559 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:10.267301 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:10.267795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:10.268561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:10.269180 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:10.317867 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:10.337092 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2fcc7663-9243-49f0-aff5-6648ba435e04 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.267716 May 12 17:18:10.338042 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 149/307] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:10 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:10.445569 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:10.456229 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7a4a9a25-618e-469b-8efb-d44c3289abaa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.202158 May 12 17:18:10.456913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 159/308] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:10 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:10.899272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:10.900445 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:10.906760 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:10.907209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:10.907969 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:10.908405 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.048271 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.056413 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d92681e6-052f-4194-8bb3-6a0bb6c7b1eb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1510 microversion: 2.1 time: 0.160496 May 12 17:18:11.056979 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 150/309] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:10 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:11.083999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:11.084601 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:11.090413 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.090886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.091642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.092072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.219300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.226455 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2d6dfd18-1183-4fc5-8a14-0369e2a89826 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1271 microversion: 2.1 time: 0.146269 May 12 17:18:11.227021 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 160/310] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:11 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:11.270820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:11.271423 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:11.277259 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.277711 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.278535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.278970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.355551 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:11.356153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:11.361884 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.362351 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.363148 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.363575 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.406920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.414645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.416743 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.418043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8b6b42cc-9a82-4a04-a03e-4d6579bdf5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1743 microversion: 2.20 time: 0.151049 May 12 17:18:11.418668 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 151/311] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:11 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:11.473505 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:11.474111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:11.480457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.480900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.481658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:11.482088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:11.487235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.496249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d202a657-18b5-4c0c-82ab-8e12a16f56b2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.145172 May 12 17:18:11.496816 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 161/312] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:11 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:11.611442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:11.619114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-af9216a8-af8c-4c8c-86da-7af3f4302279 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.148839 May 12 17:18:11.619675 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 152/313] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:11 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:11.746222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1765975989", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "networks": [{"uuid": "f0095fbe-ef8d-4ce4-8f32-e8bd7d729d75"}]}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:11.795520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] validate_networks() for [('f0095fbe-ef8d-4ce4-8f32-e8bd7d729d75', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:18:12.073680 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:12.075150 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:12.083174 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.083843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.085293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.085931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.184429 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:18:12.184846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:18:12.185336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:18:12.185735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:18:12.186170 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:18:12.195007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.195535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.196994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.197497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.217034 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Getting quotas for project 25bc4c2d7eb345d8a531f74b42d0fb91. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:18:12.221157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Getting quotas for user 35ca5db0a81843df923602a6616fdeec and project 25bc4c2d7eb345d8a531f74b42d0fb91. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:18:12.233138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:18:12.235625 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:18:12.281157 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.285346 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1cc34aed-a5b5-42ff-a19b-e07bb3574d13 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542843 May 12 17:18:12.286676 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 162/314] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:18:12.293358 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:12.294547 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-44ed4e61-e7f6-40fd-b08c-4271ec91d246 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1510 microversion: 2.1 time: 0.225300 May 12 17:18:12.295087 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:12.295786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 153/315] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:12 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:12.302360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b366eb0b-aef7-4356-8c0c-23e8fd7c261c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:12.303699 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b366eb0b-aef7-4356-8c0c-23e8fd7c261c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:12.305147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.305635 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.306406 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.309131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.363775 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b366eb0b-aef7-4356-8c0c-23e8fd7c261c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.372421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b366eb0b-aef7-4356-8c0c-23e8fd7c261c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1214 microversion: 2.1 time: 0.075333 May 12 17:18:12.373074 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 154/316] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:12 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:12.440645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:12.442689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:12.454355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.455058 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.456019 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.456628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.498928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.509641 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7337f3ab-7530-4a84-8801-e65718740ba1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.221002 May 12 17:18:12.510501 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 163/317] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:12 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:12.519562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:12.521504 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:12.533014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.533418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.534347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.534977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.704292 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.713418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-343e5608-2487-4a08-b0be-ffdc5a5c0d47 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.202016 May 12 17:18:12.721096 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 164/318] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:12 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:12.730627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:12.731503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:12.739525 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.747473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.748549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.749077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.767398 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.782321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.785782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.789619 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e05a18dc-2910-41b7-9a1c-deb6e5621aef tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1743 microversion: 2.20 time: 0.355063 May 12 17:18:12.791982 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 155/319] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:12 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1743 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:12.943071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-10c80cbb-b3f9-4b68-9b4b-ff2f0c3fb984 req-037d21af-6d06-4474-8ef8-d04e9aa64e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:12.946405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:12.954950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f93926f9-e42f-4ba8-baec-ad690bd0918e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.232356 May 12 17:18:12.955717 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 165/320] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:12 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:12.966053 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-10c80cbb-b3f9-4b68-9b4b-ff2f0c3fb984 req-037d21af-6d06-4474-8ef8-d04e9aa64e2d service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:12.967975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-10c80cbb-b3f9-4b68-9b4b-ff2f0c3fb984 req-037d21af-6d06-4474-8ef8-d04e9aa64e2d service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:12.982517 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-10c80cbb-b3f9-4b68-9b4b-ff2f0c3fb984 req-037d21af-6d06-4474-8ef8-d04e9aa64e2d service nova] Creating event network-changed:b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3 for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf on hv-cinder-84159 May 12 17:18:12.989475 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-10c80cbb-b3f9-4b68-9b4b-ff2f0c3fb984 req-037d21af-6d06-4474-8ef8-d04e9aa64e2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052925 May 12 17:18:12.990453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 156/321] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:13.311950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:13.312573 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:13.318690 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.319134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.319880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.320314 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.391276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:13.392417 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:13.400794 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.401439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.402683 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.403308 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.446291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.453674 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-54341177-84d7-45ea-97f5-4db28bfcd8d1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1516 microversion: 2.1 time: 0.145572 May 12 17:18:13.454243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 166/322] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:13 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:13.488663 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.498219 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-659675ef-a1d0-4399-9ac9-e74d1a391318 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1266 microversion: 2.1 time: 0.112252 May 12 17:18:13.507423 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 157/323] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:13 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:13.527915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:13.528765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:13.535205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.536089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.537054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.537684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.738313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:13.739340 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:13.747557 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.748690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.749656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.750904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.793878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.804719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c6b781e3-766a-4049-9f0b-3af2ea843fdc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.278391 May 12 17:18:13.804719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 167/324] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:13 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:13.811170 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:13.811771 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:13.817715 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.818166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.818981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.819411 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.913050 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.921274 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b9c1954e-1e17-48ee-846a-e986b0b18289 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.187448 May 12 17:18:13.922208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 158/325] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:13 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:13.972688 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:13.973893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.978237 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:13.983447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.984832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:13.985782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.986025 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f5417000-70a9-410c-935e-fc1b299760ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1743 microversion: 2.20 time: 0.178537 May 12 17:18:13.994222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 168/326] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:13 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:13.997226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:13.998767 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:13.999457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.213446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:14.231618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-a92c5981-5338-4448-910e-519b5a57584e req-62c03d0b-d408-4426-afef-cf58714afec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9131b16e-e337-480c-a45b-91625a94863d", "name": "network-vif-plugged", "status": "completed", "tag": "9cb1a268-4909-4277-8a38-1bb3a04f115d"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:14.237453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0b73ea7c-08f4-4f9b-91e2-450ed605d00f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.268418 May 12 17:18:14.240684 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 159/327] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:13 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:14.243871 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-a92c5981-5338-4448-910e-519b5a57584e req-62c03d0b-d408-4426-afef-cf58714afec7 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.244587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-a92c5981-5338-4448-910e-519b5a57584e req-62c03d0b-d408-4426-afef-cf58714afec7 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.265046 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-a92c5981-5338-4448-910e-519b5a57584e req-62c03d0b-d408-4426-afef-cf58714afec7 service nova] Creating event network-vif-plugged:9cb1a268-4909-4277-8a38-1bb3a04f115d for instance 9131b16e-e337-480c-a45b-91625a94863d on hv-cinder-84159 May 12 17:18:14.273846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-a92c5981-5338-4448-910e-519b5a57584e req-62c03d0b-d408-4426-afef-cf58714afec7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048075 May 12 17:18:14.275244 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 169/328] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:14.522075 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:14.525688 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:14.535038 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.535679 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.537584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.538314 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.819781 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:14.821067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:14.831589 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.832287 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.833301 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.833924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.873050 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:14.885236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-95aba941-04fd-4b21-a564-5606668831eb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.370993 May 12 17:18:14.889036 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 160/329] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:14 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:14.897984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4117b427-412f-4066-ac1b-df85bda8f52d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'create', calling method: .version_select at 0x7f78b41c4040>, body: {"keypair": {"name": "tempest-keypair-1180296754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHtYajdy9h8c2wP4NAskHzcwC4S65i+acZRHnF3lw8zkA78qj2g+C/aZVJ7kcn+xXYtFkuJGU+vqIeIY2HQ+l7EeRgXZgI9NjJ0zUGHpQWHVbBSYQaqysUVi3DBe6ZvUw=="}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:14.916880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-4117b427-412f-4066-ac1b-df85bda8f52d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for project 638166bec22640968de80cfeaeed437b. Resources: {'key_pairs'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:18:14.920770 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-4117b427-412f-4066-ac1b-df85bda8f52d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for user 650969502a9f41e38066a7c269d84ab7 and project 638166bec22640968de80cfeaeed437b. Resources: {'key_pairs'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:18:14.960214 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4117b427-412f-4066-ac1b-df85bda8f52d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069900 May 12 17:18:14.966623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 161/330] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:18:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:14.969948 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:14.970709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:14.976638 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.977060 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:14.978618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:14.979354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.073878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:15.081296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9a579cce-a597-4736-b7b5-2d61e8074cdb tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.267813 May 12 17:18:15.082210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 170/331] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:14 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:15.088213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:15.089117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:15.095353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.095794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.096551 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.096976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.113379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:15.121964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-67c153ce-087c-4c61-bb5e-29253bb83ca2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.157629 May 12 17:18:15.122773 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 162/332] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:14 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:15.258346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:15.259497 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:15.265539 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.265991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.266785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.267215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.372585 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:15.381741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:15.385761 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:15.387770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9560ac4f-7467-41b6-a8a2-6b2880681575 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1743 microversion: 2.20 time: 0.304634 May 12 17:18:15.401640 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 171/333] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:15 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:15.604030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-7e9555c0-4e92-4626-a6ef-6278333161ef req-2ae565d1-753d-441e-a28f-871def604fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b3ac3e-21c3-4c75-86bf-14b661b8edb9", "tag": "cbf9c7ae-65bd-45a9-914a-7e9e91a7a565"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:15.612066 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-7e9555c0-4e92-4626-a6ef-6278333161ef req-2ae565d1-753d-441e-a28f-871def604fe5 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.612508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-7e9555c0-4e92-4626-a6ef-6278333161ef req-2ae565d1-753d-441e-a28f-871def604fe5 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.625404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-7e9555c0-4e92-4626-a6ef-6278333161ef req-2ae565d1-753d-441e-a28f-871def604fe5 service nova] Creating event network-changed:cbf9c7ae-65bd-45a9-914a-7e9e91a7a565 for instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 on hv-cinder-84159 May 12 17:18:15.631550 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-7e9555c0-4e92-4626-a6ef-6278333161ef req-2ae565d1-753d-441e-a28f-871def604fe5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030816 May 12 17:18:15.632474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 172/334] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:18:15.701451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:15.708674 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9e7823e0-1c5e-4355-9990-5faed6e7da30 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1265 microversion: 2.1 time: 0.454499 May 12 17:18:15.709250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 163/335] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:15 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:15.905394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:15.905796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:15.918684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.919365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:15.920309 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:15.920782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.099072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:16.100204 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:16.109758 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.110992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.111959 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.113023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.162358 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:16.170506 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-fcc3b81f-bb5b-49de-81a0-f33dba26312c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.271863 May 12 17:18:16.171171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 173/336] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:15 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:16.184482 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:16.185382 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:16.191530 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.192057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.193033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.193534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.326148 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:16.333950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-94a35084-b285-4cae-8cc3-56fe59483aae tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.153241 May 12 17:18:16.334655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 174/337] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:16 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:16.339681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-6ac9e98a-8f7e-4df0-bdc6-538e1316bc90 req-ef17d975-e783-4bc0-87db-835c47a6590a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "name": "network-vif-plugged", "status": "completed", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:16.347301 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:16.347747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-6ac9e98a-8f7e-4df0-bdc6-538e1316bc90 req-ef17d975-e783-4bc0-87db-835c47a6590a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.348286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-6ac9e98a-8f7e-4df0-bdc6-538e1316bc90 req-ef17d975-e783-4bc0-87db-835c47a6590a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.355424 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2c256bf7-295f-44d1-b8f1-fbaaef035f50 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.261488 May 12 17:18:16.356188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 164/338] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:16 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:16.360784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-6ac9e98a-8f7e-4df0-bdc6-538e1316bc90 req-ef17d975-e783-4bc0-87db-835c47a6590a service nova] Creating event network-vif-plugged:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:18:16.366724 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-6ac9e98a-8f7e-4df0-bdc6-538e1316bc90 req-ef17d975-e783-4bc0-87db-835c47a6590a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030772 May 12 17:18:16.367546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 175/339] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:16.405588 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:16.406223 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:16.412229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.412677 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.414020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.414020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.596464 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:16.604790 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:16.606362 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:16.607517 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3922253f-2500-4286-b06a-8e7a7c357caf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.205832 May 12 17:18:16.608400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 165/340] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:16 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:16.727072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:16.728967 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:16.737697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.738711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:16.740459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:16.741045 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.142551 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1447797140", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff0d6338-2300-4010-ae74-9c2289a9588a"}], "security_groups": [{"name": "tempest-securitygroup--1385929519"}], "key_name": "tempest-keypair-1180296754", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:17.174377 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:17.187123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0c81a431-409e-49e9-9058-82564e6a14ff tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1451 microversion: 2.1 time: 0.465489 May 12 17:18:17.189599 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 176/341] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:16 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1451 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:17.211330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:17.212611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:17.238646 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.239195 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.240422 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.240930 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.283434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] validate_networks() for [('ff0d6338-2300-4010-ae74-9c2289a9588a', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:18:17.478035 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:17.491031 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-fe385a3b-883a-4b68-94fb-fa51c426da31 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.285970 May 12 17:18:17.491709 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 177/342] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:17 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:17.502868 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:17.503484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:17.512218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.512673 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.513453 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.513884 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.762744 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:18:17.763613 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:18:17.764090 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:18:17.764496 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:18:17.764931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:18:17.776430 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.777124 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.778435 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.779051 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.780571 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:17.791570 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-31dcc7e4-e640-490a-a7aa-099d45457ce7 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1451 microversion: 2.1 time: 0.292304 May 12 17:18:17.792549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 178/343] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:17 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1451 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:17.798388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:17.799376 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:17.811161 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for project 638166bec22640968de80cfeaeed437b. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:18:17.822556 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.824212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Getting quotas for user 650969502a9f41e38066a7c269d84ab7 and project 638166bec22640968de80cfeaeed437b. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:18:17.827019 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.828511 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.831773 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.847416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:18:17.849683 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:18:17.932139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-483dd04d-6946-454e-bdf1-4feac2a73871 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.794126 May 12 17:18:17.932863 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 166/344] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:18:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:18:17.938303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:17.938962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:17.945681 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.946170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:17.947188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:17.947619 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:18.115154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.124677 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2c809c98-7dd3-4991-a09b-ce0f32b8da2c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.330872 May 12 17:18:18.125278 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 179/345] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:17 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:18.141279 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:18.143141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:18.167921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:18.168120 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:18.176483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:18.177187 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:18.204678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.214059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bbbe6bec-ed8d-48f1-bf44-6711efa9d0c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.280158 May 12 17:18:18.225202 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 167/346] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:17 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:18.231338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6d357b43-98cd-45e5-9927-6fdcca916571 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:18.232988 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6d357b43-98cd-45e5-9927-6fdcca916571 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:18.310729 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6d357b43-98cd-45e5-9927-6fdcca916571 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.317967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6d357b43-98cd-45e5-9927-6fdcca916571 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1246 microversion: 2.1 time: 0.091239 May 12 17:18:18.330378 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 168/347] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:18 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:18.510797 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:18.511700 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:18.521802 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:18.522566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:18.523603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:18.524840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:18.631167 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.652604 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.655507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.656860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ace08797-986d-434a-b323-a4e156c91e2a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.530067 May 12 17:18:18.657579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 180/348] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:18 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:18.706581 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:18.718846 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e2fa2a9e-19f9-45d5-8b65-0617eaa8d32b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.214396 May 12 17:18:18.720304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 169/349] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:18 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:19.142268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:19.142910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:19.160113 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.164888 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.165804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.166299 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.244215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:19.246083 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:19.253188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.253638 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.254678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.255263 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.425599 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:19.443480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d1148588-30f2-4b0b-9235-61fbe576ac95 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.303861 May 12 17:18:19.444663 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:19.445023 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 181/350] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:19 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:19.451007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:19.451783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:19.457200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9bbb2215-5267-4fe7-be3a-cd52eeb40562 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.228352 May 12 17:18:19.457786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 170/351] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:19 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:19.458587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.459211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.460286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.460858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.561285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:19.568949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-26ab40cb-b59d-44cd-a9b2-c57e6d90c034 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1298 microversion: 2.1 time: 0.122641 May 12 17:18:19.571261 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 182/352] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:19 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:19.680880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:19.681824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:19.688009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.688718 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.689688 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.690321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.736594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:19.737332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:19.749560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.756754 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.757967 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:19.758591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:19.905761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:19.915763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:19.917701 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:19.919716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-024c8297-e233-4bd2-9459-3257312e124e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.247225 May 12 17:18:19.920782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 171/353] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:19 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:20.027463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:20.040008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5e4dc1d9-c57c-4f25-bb28-2fbd381b9e9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.307069 May 12 17:18:20.042278 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 183/354] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:19 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:20.467081 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:20.473207 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:20.473805 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:20.475308 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:20.488270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.489441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.491480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.492009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.492636 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.493748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.494702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.496449 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.780564 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:20.805189 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7547a048-10bf-4c6d-b2a9-84e5e32706e4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.343869 May 12 17:18:20.808014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 172/355] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:20 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:20.814901 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:20.815716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:20.831071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.831906 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.833060 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.833702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.897174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:20.904878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c0085e4b-79c1-4b43-96d7-e8a65d95889a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.435444 May 12 17:18:20.905475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 184/356] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:20 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:20.943769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:20.944637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:20.951105 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.951797 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.952747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:20.953337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:20.973597 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:20.991012 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-47874d26-54e3-4402-b127-4b4193cf7809 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1316 microversion: 2.1 time: 0.181486 May 12 17:18:21.002228 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 173/357] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:20 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:21.058955 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:21.059968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:21.073893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.074674 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:21.076077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.076811 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:21.229984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:21.240644 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ade99d06-6931-49b3-9a64-35e8c4a89619 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.187302 May 12 17:18:21.241760 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 174/358] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:21 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:21.285526 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:21.295614 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:21.297122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:21.298304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2e3dc3d5-a2db-416f-a885-d18c1c238bc8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.358646 May 12 17:18:21.318477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 185/359] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:20 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:21.653623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-302ec953-1128-459e-97fc-3ab364c78dee req-b2100f78-6251-461e-a3bd-ec474e05ae1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9131b16e-e337-480c-a45b-91625a94863d", "tag": "9cb1a268-4909-4277-8a38-1bb3a04f115d"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:21.667708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-302ec953-1128-459e-97fc-3ab364c78dee req-b2100f78-6251-461e-a3bd-ec474e05ae1f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.668156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-302ec953-1128-459e-97fc-3ab364c78dee req-b2100f78-6251-461e-a3bd-ec474e05ae1f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:21.691830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-302ec953-1128-459e-97fc-3ab364c78dee req-b2100f78-6251-461e-a3bd-ec474e05ae1f service nova] Creating event network-changed:9cb1a268-4909-4277-8a38-1bb3a04f115d for instance 9131b16e-e337-480c-a45b-91625a94863d on hv-cinder-84159 May 12 17:18:21.699073 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-302ec953-1128-459e-97fc-3ab364c78dee req-b2100f78-6251-461e-a3bd-ec474e05ae1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051994 May 12 17:18:21.701227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 175/360] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:21.824749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:21.825365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:21.832722 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.833655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:21.835536 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.836132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:21.922437 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:21.923247 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:21.934409 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.941779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:21.942882 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:21.943437 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.296393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:22.304893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-451151e8-9189-4fa0-baa0-0606a9c31bda tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.387351 May 12 17:18:22.319390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 176/361] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:21 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:22.323382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:22.324115 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:22.336977 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:22.338124 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.339216 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:22.339801 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.349456 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:22.360165 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8652b528-254b-482e-a7d6-52c2cf6784ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.539838 May 12 17:18:22.371764 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 186/362] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:21 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:22.384153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:22.392009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:22.405425 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:22.409524 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.412984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:22.424693 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.812274 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:22.821059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4f90f20d-1bb4-47a4-a339-e2123f9d5c59 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.508122 May 12 17:18:22.821669 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 177/363] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:22 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:22.836372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:22.837655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:22.847878 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:22.848421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.849280 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:22.849772 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:22.983447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:22.991985 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-49a11c49-8a3d-4995-aa2c-f7b3961ef5ce tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.617303 May 12 17:18:22.994176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 187/364] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:22 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:23.099201 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:23.107401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:23.108895 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:23.110049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-65dc6477-d2f0-4b52-a0c4-48aca1ddb8ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.278502 May 12 17:18:23.120361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 178/365] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:22 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:23.338540 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:23.339585 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:23.346791 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.347480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.348423 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.356634 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.378757 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:23.379725 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:23.395029 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.396165 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.397644 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.398528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.591940 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:23.606706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-55e5768d-0dd4-4fbf-be72-dd288f3a05ed tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.231580 May 12 17:18:23.607534 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 179/366] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:23 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:23.711094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:23.719136 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e6cbcf04-7213-4f93-b6be-b4e013acd2ad tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.395005 May 12 17:18:23.730699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 188/367] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:23 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:23.838727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:23.839523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:23.848862 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.849331 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.850044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.850638 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.910407 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-1a5302c2-32cb-49a8-b265-990900604452 req-06d3cfdd-ea43-4a37-9198-c3dbf8860667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef", "tag": "e25fed55-18b6-4d75-bd0e-374461b42fe4"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:23.927166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-1a5302c2-32cb-49a8-b265-990900604452 req-06d3cfdd-ea43-4a37-9198-c3dbf8860667 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:23.927585 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-1a5302c2-32cb-49a8-b265-990900604452 req-06d3cfdd-ea43-4a37-9198-c3dbf8860667 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:23.959845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-1a5302c2-32cb-49a8-b265-990900604452 req-06d3cfdd-ea43-4a37-9198-c3dbf8860667 service nova] Creating event network-changed:e25fed55-18b6-4d75-bd0e-374461b42fe4 for instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef on hv-cinder-84159 May 12 17:18:23.976329 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-1a5302c2-32cb-49a8-b265-990900604452 req-06d3cfdd-ea43-4a37-9198-c3dbf8860667 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069229 May 12 17:18:23.979544 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 189/368] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:18:24.012246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:24.013855 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:24.033802 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.033802 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.038131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.038861 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.084179 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.094341 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5b798b13-691b-4cb7-a6a7-4df8312c2299 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.259628 May 12 17:18:24.096792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 180/369] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:23 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:24.128619 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:24.129598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:24.140965 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.141876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.142940 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.143811 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.355109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.363709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.364665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b3386ac9-4af9-4236-bbe4-134b25609740 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.357019 May 12 17:18:24.375779 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 190/370] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:24 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:24.380554 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.383052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.385683 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1f289819-e29b-468b-8757-fd50a226def4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.261306 May 12 17:18:24.396572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 181/371] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:24 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:24.627511 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:24.628414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:24.643134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.643881 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.644719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.645541 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.741641 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:24.742254 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:24.748758 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.749230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.749997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:24.752650 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:24.807466 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.827105 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-db474b06-63ce-40d5-b059-4b4bfea2479c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.201631 May 12 17:18:24.834874 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 191/372] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:24 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:24.916926 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:24.924472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5879e3d5-d15c-45cf-933c-b8bea7196f03 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.190720 May 12 17:18:24.925041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 182/373] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:24 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:25.113137 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:25.113757 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:25.121930 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.122372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.123372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.123810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.263612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:25.271534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2cc6e1d8-7300-440f-bcf5-283382a52286 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.162187 May 12 17:18:25.275435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 192/374] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:25 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:25.383060 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:25.384139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:25.391003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.391503 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.392278 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.392993 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.404075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:25.405403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:25.412718 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.413444 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.414437 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.415698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.558848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:25.569847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:25.578030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:25.579560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:25.580153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b5f0fccd-5922-4779-86ef-36b947d79601 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.187960 May 12 17:18:25.580712 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-35e945bb-cdd9-459e-a258-3dcdfe150bf3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.180541 May 12 17:18:25.581577 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 183/375] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:25 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:25.581806 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 193/376] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:25 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:25.844168 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:25.844774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:25.853573 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.853914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.854737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.855177 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.941903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:25.943069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:25.952679 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.953072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:25.954026 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:25.954767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.079346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.089010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-de51f70e-8e92-417b-b26b-1cb742bccb38 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1723 microversion: 2.1 time: 0.248620 May 12 17:18:26.099899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 184/377] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:25 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:26.247207 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-f0517d70-809c-41b7-88a5-b773f22903ca req-47a5c17b-b975-4fd0-8c86-ae19b86ec8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "name": "network-vif-plugged", "status": "completed", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:26.264166 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f0517d70-809c-41b7-88a5-b773f22903ca req-47a5c17b-b975-4fd0-8c86-ae19b86ec8b3 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.266175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f0517d70-809c-41b7-88a5-b773f22903ca req-47a5c17b-b975-4fd0-8c86-ae19b86ec8b3 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.288063 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-f0517d70-809c-41b7-88a5-b773f22903ca req-47a5c17b-b975-4fd0-8c86-ae19b86ec8b3 service nova] Creating event network-vif-plugged:b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3 for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf on hv-cinder-84159 May 12 17:18:26.303876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-f0517d70-809c-41b7-88a5-b773f22903ca req-47a5c17b-b975-4fd0-8c86-ae19b86ec8b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060261 May 12 17:18:26.306544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 185/378] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:18:26.315253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:26.316355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:26.323961 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.324778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.326537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.327182 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.458109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.467751 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3f624a70-fb17-4fd5-bfc3-ddd16320af5f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.530007 May 12 17:18:26.473393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 194/379] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:25 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:26.511991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.520375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-dc1758d6-b974-4d98-b3c2-2fd817f41fe9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.211774 May 12 17:18:26.522258 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 186/380] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:26 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:26.599414 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:26.600362 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:26.601852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:26.603166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:26.609645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.610646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.611761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.612356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.623474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.623921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.624706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:26.625143 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:26.815138 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.828621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.830060 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.831294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c6a75566-0817-4cad-9586-408dca74e900 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.236082 May 12 17:18:26.831848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 187/381] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:26 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:26.901208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:26.909655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3896cd8d-5429-4387-8af2-3f6f9941392f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.315001 May 12 17:18:26.910232 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 195/382] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:26 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:27.107251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:27.108446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:27.115890 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.116332 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.118285 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.118758 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.287855 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:27.301262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a4fb1bbd-0aa0-4253-84ef-b8ce7355a51f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1700 microversion: 2.1 time: 0.199782 May 12 17:18:27.301849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 188/383] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:27 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1700 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:27.318854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2bc95517-921c-4d1d-96fb-2806abe7f9f6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:27.326881 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2bc95517-921c-4d1d-96fb-2806abe7f9f6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.327357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2bc95517-921c-4d1d-96fb-2806abe7f9f6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.352074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2bc95517-921c-4d1d-96fb-2806abe7f9f6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Going to try to start instance {{(pid=117075) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 17:18:27.406658 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2bc95517-921c-4d1d-96fb-2806abe7f9f6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action" status: 202 len: 0 microversion: 2.1 time: 0.091388 May 12 17:18:27.408500 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 196/384] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:18:27 2022] POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:18:27.416385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:27.417129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:27.423475 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.424003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.424867 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.425382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.487179 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:27.488022 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:27.506094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.506910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.508074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.508638 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.588651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:27.598893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-864cb41e-befe-42fb-9f80-33aab1d42f68 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1709 microversion: 2.1 time: 0.186301 May 12 17:18:27.608964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 189/385] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:27 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1709 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:27.608964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:27.608964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:27.616727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.617438 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.619039 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.620039 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.694821 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:27.704641 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-566a4233-ae89-43fb-bb61-d72c3a9a87da tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1259 microversion: 2.1 time: 0.221964 May 12 17:18:27.714716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 197/386] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:27 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:27.787417 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:27.795310 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-83ffe542-ec8c-4bf0-81c9-32176603b5c1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.194301 May 12 17:18:27.796109 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 190/387] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:27 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:27.849729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:27.850465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:27.857727 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.857727 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.858112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.860915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.933801 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:27.934441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:27.942035 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.942582 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:27.954694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:27.955257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:28.165343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:28.174395 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-15503fa1-1661-4715-a369-35fc0cbaaddb tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.245019 May 12 17:18:28.175448 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 191/388] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:27 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:28.182027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:28.197166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:28.198681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:28.200405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-175745bf-3eda-4157-99c7-95273157c00b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.354724 May 12 17:18:28.200965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 198/389] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:27 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:28.360053 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-a622ca76-41eb-471a-8863-c0f3e576bbc7 req-8b632041-4599-4f00-82ad-76eac19495de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ac3e-21c3-4c75-86bf-14b661b8edb9", "name": "network-vif-plugged", "status": "completed", "tag": "cbf9c7ae-65bd-45a9-914a-7e9e91a7a565"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:28.369954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a622ca76-41eb-471a-8863-c0f3e576bbc7 req-8b632041-4599-4f00-82ad-76eac19495de service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:28.370568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a622ca76-41eb-471a-8863-c0f3e576bbc7 req-8b632041-4599-4f00-82ad-76eac19495de service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:28.382907 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-a622ca76-41eb-471a-8863-c0f3e576bbc7 req-8b632041-4599-4f00-82ad-76eac19495de service nova] Creating event network-vif-plugged:cbf9c7ae-65bd-45a9-914a-7e9e91a7a565 for instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 on hv-cinder-84159 May 12 17:18:28.388155 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-a622ca76-41eb-471a-8863-c0f3e576bbc7 req-8b632041-4599-4f00-82ad-76eac19495de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 May 12 17:18:28.392072 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 192/390] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:28.625199 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:28.635864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:28.655960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:28.660988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:28.663882 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:28.665844 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:28.726578 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:28.736493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:28.759110 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:28.762617 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:28.765541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:28.775745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:28.985973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:28.988269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:28.994082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1baf2375-5d08-4a66-a2de-d51291d11efa tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1443 microversion: 2.1 time: 0.274728 May 12 17:18:28.995002 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 193/391] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:28 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1443 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:28.999890 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:29.000635 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:29.007791 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.008837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.009659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.010095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.010666 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b49b582f-a467-4d47-a689-b4d0153cd0b0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1709 microversion: 2.1 time: 0.396654 May 12 17:18:29.023745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 199/392] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:28 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1709 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:29.026638 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:29.027379 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:29.037275 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.037731 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.038537 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.039222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.165933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:29.173190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a4abb880-bb6a-4a94-a090-03a84664a52a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.177132 May 12 17:18:29.173761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 194/393] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:28 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:29.194198 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:29.195108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:29.201846 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.202289 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.203083 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.203519 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.207001 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:29.216440 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7be01ee5-2afe-4174-84ac-1a564a37f7bd tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1443 microversion: 2.1 time: 0.200575 May 12 17:18:29.217017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 200/394] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:29 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1443 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:29.221368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:29.222453 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:29.227848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.228291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.229057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:29.229487 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:29.333441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:29.341620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-712a928c-ac5a-4d7d-ba39-5696d8af9c92 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.152183 May 12 17:18:29.343389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 195/395] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:29 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:29.450814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:29.458643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:29.460152 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:29.461346 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9742881a-5aca-4d8b-964d-01bff3dba85a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1738 microversion: 2.20 time: 0.243392 May 12 17:18:29.462078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 201/396] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:29 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:30.031964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:30.032524 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:30.038627 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.039081 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.039831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.040255 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.189530 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:30.190339 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:30.197234 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.197747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.198613 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.199212 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.250687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:30.260284 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a351072e-31d7-4d7f-90e2-4c345efe988d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1709 microversion: 2.1 time: 0.232659 May 12 17:18:30.261117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 196/397] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:30 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1709 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:30.336857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:30.344724 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-172ca42f-5f6d-4912-a452-72d669fd2eb1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.159105 May 12 17:18:30.345305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 202/398] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:30 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:30.358928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:30.359532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:30.365342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.365792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.366586 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.367028 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.403468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-817210f5-45ba-420f-9f88-17dbad594971 req-0a72ea08-18e8-49d1-ab29-7ec6fed25d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef", "name": "network-vif-plugged", "status": "completed", "tag": "e25fed55-18b6-4d75-bd0e-374461b42fe4"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:30.411749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-817210f5-45ba-420f-9f88-17dbad594971 req-0a72ea08-18e8-49d1-ab29-7ec6fed25d5b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.412446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-817210f5-45ba-420f-9f88-17dbad594971 req-0a72ea08-18e8-49d1-ab29-7ec6fed25d5b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.423654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-817210f5-45ba-420f-9f88-17dbad594971 req-0a72ea08-18e8-49d1-ab29-7ec6fed25d5b service nova] Creating event network-vif-plugged:e25fed55-18b6-4d75-bd0e-374461b42fe4 for instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef on hv-cinder-84159 May 12 17:18:30.428561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-817210f5-45ba-420f-9f88-17dbad594971 req-0a72ea08-18e8-49d1-ab29-7ec6fed25d5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028712 May 12 17:18:30.429291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 203/399] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:18:30.480239 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:30.480924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:30.486899 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.487697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.488157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:30.488580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:30.571020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:30.579509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e60781a0-8a20-420f-9165-b83fc0e38ecd tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1314 microversion: 2.1 time: 0.224369 May 12 17:18:30.588673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 197/400] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:30 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:30.620277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:30.628413 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:30.629897 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:30.631051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-50ad3f9e-596c-4719-8fe8-267d6cd429ec tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1720 microversion: 2.20 time: 0.155719 May 12 17:18:30.631848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 204/401] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:30 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:31.277060 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:31.277669 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:31.283938 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.284378 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.285127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.285553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.361036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:31.361641 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:31.368388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.368862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.369640 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.370072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.484875 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:31.500324 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e7e09303-eb68-4501-aa13-abe459a0004f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1709 microversion: 2.1 time: 0.226851 May 12 17:18:31.501485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 198/402] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:31 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1709 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:31.515000 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-467952d0-1809-440d-8cc8-2e45c43a73e5 req-c576cdb9-00af-4f01-aa77-934f1aec68ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:31.524159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-467952d0-1809-440d-8cc8-2e45c43a73e5 req-c576cdb9-00af-4f01-aa77-934f1aec68ff service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.524596 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-467952d0-1809-440d-8cc8-2e45c43a73e5 req-c576cdb9-00af-4f01-aa77-934f1aec68ff service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.535939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-467952d0-1809-440d-8cc8-2e45c43a73e5 req-c576cdb9-00af-4f01-aa77-934f1aec68ff service nova] Creating event network-changed:b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3 for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf on hv-cinder-84159 May 12 17:18:31.541623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-467952d0-1809-440d-8cc8-2e45c43a73e5 req-c576cdb9-00af-4f01-aa77-934f1aec68ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030198 May 12 17:18:31.545141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 199/403] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:31.556656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:31.563966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-236d4baf-2c93-429a-9346-998c82de2a32 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.206794 May 12 17:18:31.564528 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 205/404] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:31 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:31.596070 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:31.596992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:31.604356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.604356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.605119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.605616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.651750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:31.652351 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:31.658181 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.658916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.659671 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:31.660130 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:31.751119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:31.759316 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d5d4f14f-d0bd-4334-847a-c53362999402 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1498 microversion: 2.1 time: 0.167354 May 12 17:18:31.759880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 200/405] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:31 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:31.800215 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:31.809531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:31.811305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:31.812465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e48e155f-543a-4e60-9f60-4d130c288a99 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1720 microversion: 2.20 time: 0.165220 May 12 17:18:31.813503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 206/406] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:31 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:32.261299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:32.261797 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:32.275346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.275789 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.276629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.277109 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.340859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:18:32.464789 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f6b597c4-c056-4c21-9ac6-7f33f5a1ab07 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "DELETE /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 204 len: 0 microversion: 2.1 time: 0.208262 May 12 17:18:32.465517 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 201/407] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:18:32 2022] DELETE /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:18:32.473730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:32.475010 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:32.481308 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.481759 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.482562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.482994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.517488 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:32.518208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:32.524468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.524923 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.525709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.526155 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.637545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:32.645153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e27cfca8-4012-497c-9cd0-7d9706ea6333 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1504 microversion: 2.1 time: 0.175230 May 12 17:18:32.645853 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 207/408] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:32 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:32.650742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:32.651450 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:32.658224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.658711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.659488 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.659926 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.683707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:32.691943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-189e7f7c-e88d-4bac-aeed-a658d3e27efa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1713 microversion: 2.1 time: 0.178583 May 12 17:18:32.692707 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 202/409] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:32 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1713 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:32.794654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:32.802474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f49e0e71-08fe-424a-8672-0944e772af8d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.155255 May 12 17:18:32.803038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 208/410] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:32 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:32.830508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:32.831061 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:32.837086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.837533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.838305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:32.838877 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:32.964641 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:32.972172 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:32.973646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:32.974796 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f048295f-b3d9-4f0f-aece-fd0ca89ace03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1720 microversion: 2.20 time: 0.148246 May 12 17:18:32.975348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 203/411] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:32 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:33.662321 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:33.662964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:33.668818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:33.669259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:33.670000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:33.670434 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:33.797035 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:33.804280 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bb91858e-e7ba-47f7-9cc2-75c442edf02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1504 microversion: 2.1 time: 0.145892 May 12 17:18:33.804833 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 209/412] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:33 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:33.819487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:33.820084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:33.826894 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:33.827338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:33.828089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:33.828515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:33.954880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:33.961998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-18c9b716-5214-400f-96cb-5a195bc55209 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.146416 May 12 17:18:33.962570 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 204/413] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:33 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:33.996695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:33.997353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:34.003168 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.003606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:34.004361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.004782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:34.076563 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-38440272-9d6e-4e24-a95e-88dc5ec97d7c req-fdeb04aa-02b8-463d-8117-e29314c1a4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "name": "network-vif-unplugged", "status": "completed", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:34.085055 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-38440272-9d6e-4e24-a95e-88dc5ec97d7c req-fdeb04aa-02b8-463d-8117-e29314c1a4c1 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.085492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-38440272-9d6e-4e24-a95e-88dc5ec97d7c req-fdeb04aa-02b8-463d-8117-e29314c1a4c1 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:34.098513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-38440272-9d6e-4e24-a95e-88dc5ec97d7c req-fdeb04aa-02b8-463d-8117-e29314c1a4c1 service nova] Creating event network-vif-unplugged:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:18:34.104255 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-38440272-9d6e-4e24-a95e-88dc5ec97d7c req-fdeb04aa-02b8-463d-8117-e29314c1a4c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031848 May 12 17:18:34.105559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 205/414] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:34.135474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:34.143609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:34.145502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:34.146283 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0bbf2ae6-2dc0-4bfe-bc8e-314f6f010b8c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1720 microversion: 2.20 time: 0.155007 May 12 17:18:34.146859 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 210/415] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:33 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:34.822153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:34.822876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:34.829366 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.829812 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:34.830593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.831026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:34.979404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:34.980042 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:34.987041 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.987494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:34.988266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:34.988704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:35.094241 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:35.102590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-44553337-982f-4367-9595-04130bc09b32 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1504 microversion: 2.1 time: 0.284677 May 12 17:18:35.103159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 206/416] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:34 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:35.122961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:35.130220 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-742c7198-8d70-45dc-97c0-2ee71b69f301 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.155379 May 12 17:18:35.130920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 211/417] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:34 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:35.164235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:35.165472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:35.171413 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:35.171858 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:35.172616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:35.173044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:35.370913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:35.378651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:35.380141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:35.381284 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6bf8904e-de06-4790-85e1-23d853a67a0c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1720 microversion: 2.20 time: 0.220970 May 12 17:18:35.381844 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 207/418] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:35 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:35.539113 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-3f40fe98-02e5-442f-b0d6-17b850584e77 req-2584fb4a-9bcf-49da-b215-122a8bc4ade0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b3ac3e-21c3-4c75-86bf-14b661b8edb9", "name": "network-vif-deleted", "tag": "cbf9c7ae-65bd-45a9-914a-7e9e91a7a565"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:35.547677 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-3f40fe98-02e5-442f-b0d6-17b850584e77 req-2584fb4a-9bcf-49da-b215-122a8bc4ade0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:35.548115 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-3f40fe98-02e5-442f-b0d6-17b850584e77 req-2584fb4a-9bcf-49da-b215-122a8bc4ade0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:35.558972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-3f40fe98-02e5-442f-b0d6-17b850584e77 req-2584fb4a-9bcf-49da-b215-122a8bc4ade0 service nova] Creating event network-vif-deleted:cbf9c7ae-65bd-45a9-914a-7e9e91a7a565 for instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 on hv-cinder-84159 May 12 17:18:35.563868 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-3f40fe98-02e5-442f-b0d6-17b850584e77 req-2584fb4a-9bcf-49da-b215-122a8bc4ade0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028278 May 12 17:18:35.564445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 212/419] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:36.119859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:36.120455 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:36.126848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:36.127288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:36.128028 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:36.128453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:36.148907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:36.149535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:36.155607 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:36.156056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:36.156817 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:36.157249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:36.190811 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:36.198822 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bf966937-c145-42bf-9f6d-57e1042c6a4e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1462 microversion: 2.1 time: 0.083255 May 12 17:18:36.199382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 208/420] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:36 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:36.288937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:36.296213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a226076f-a54d-4681-a73e-882bef3a8664 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1372 microversion: 2.1 time: 0.152065 May 12 17:18:36.296779 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 213/421] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:36 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:36.399273 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:36.399817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:36.405607 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:36.406058 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:36.406847 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:36.407281 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:36.532521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:36.540661 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:36.542186 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:36.543353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5d2e7e9e-4d9c-460c-95b7-620438baa127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1720 microversion: 2.20 time: 0.148037 May 12 17:18:36.543916 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 209/422] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:36 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:37.216168 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:37.216686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:37.225038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.225488 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.226265 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.226730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.289976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:37.297131 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4496920e-a073-4cc5-b865-afc4f474ab47 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 200 len: 1299 microversion: 2.1 time: 0.085421 May 12 17:18:37.297716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 214/423] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:37 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:37.312755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:37.313352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:37.319563 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.320001 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.321272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.321696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.459149 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:37.467230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a0a09a62-199b-417c-93ca-fae435c31522 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1567 microversion: 2.1 time: 0.158110 May 12 17:18:37.468043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 210/424] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:37 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:37.483851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:37.484341 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:37.490484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.491158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.491926 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.492557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.561243 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:37.561953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:37.567922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.568391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.569144 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.569573 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.571705 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-52862d5a-3b52-4116-8d23-8594c6dbf9e8 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091698 May 12 17:18:37.572414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 215/425] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:18:37 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:37.699632 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:37.707550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:37.709174 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:37.710403 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8415a4c7-fc9b-4f43-9b57-7ee688a66182 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1723 microversion: 2.20 time: 0.153202 May 12 17:18:37.711085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 211/426] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:37 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:37.729156 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6f9b92f-6de0-4a85-a18f-6feb72ace1b3"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:37.729857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:37.735938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.736615 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:37.737387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:37.737817 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.051417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-dc362449-4762-4f01-91ea-9e389b84f885 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327432 May 12 17:18:38.052395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 216/427] 10.222.0.23 () {62 vars in 1363 bytes} [Thu May 12 17:18:37 2022] POST /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:18:38.215276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:38.215851 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:38.222559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:38.223013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.223834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:38.224761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.313412 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:38.313974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 99b3ac3e-21c3-4c75-86bf-14b661b8edb9] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:38.320155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:38.320642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.321549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:38.322255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.323495 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-678a6031-3c2b-42a6-994c-93d9c3b75592 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/action" status: 202 len: 0 microversion: 2.20 time: 0.113099 May 12 17:18:38.324479 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 212/428] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 12 17:18:38 2022] POST /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:18:38.332203 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:38.333013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:38.341083 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:38.341706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.342998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:38.343837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:38.343960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] HTTP exception thrown: Instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 could not be found. May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Request method failure captured: May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 HTTP/1.1 May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUFRgXehFvYe5zpYdUu0UvdkDR8PKa3XnxbumTx5l5-8sqMt-l1_xpAHK_l__iAlENzaI-Sq7UV4jUg9oLD7xPG9OmAp2zbLIW5tk4pzY-80yaj-Thlf0h7iGcRmqpHn8TOKSaiznsxCi78XAt7UWovXH7wiab59qugSuzc5aslPm0s May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 25bc4c2d7eb345d8a531f74b42d0fb91 May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesActionsTest-310690744 May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:18:38.345683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesActionsTest-310690744 May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 25bc4c2d7eb345d8a531f74b42d0fb91 May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesActionsTest-310690744 May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesActionsTest-310690744-project May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 35ca5db0a81843df923602a6616fdeec May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesActionsTest-310690744-project May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 could not be found. May 12 17:18:38.347036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '99b3ac3e-21c3-4c75-86bf-14b661b8edb9'} May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 could not be found. May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:18:38.347846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 could not be found. May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 could not be found. May 12 17:18:38.349098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:18:38.353542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Returning 404 to user: Instance 99b3ac3e-21c3-4c75-86bf-14b661b8edb9 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:18:38.354562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c0a6f829-a89b-45d1-8a79-1037a424cd89 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9" status: 404 len: 111 microversion: 2.1 time: 0.045430 May 12 17:18:38.366518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 217/429] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:38 2022] GET /compute/v2.1/servers/99b3ac3e-21c3-4c75-86bf-14b661b8edb9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:18:38.415725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1048477467", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "networks": [{"uuid": "f0095fbe-ef8d-4ce4-8f32-e8bd7d729d75"}]}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:38.478209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] validate_networks() for [('f0095fbe-ef8d-4ce4-8f32-e8bd7d729d75', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:18:38.508649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:38.517766 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:38.519342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:38.520512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c86be9a0-af6f-474c-8c8f-b937166b5a46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1749 microversion: 2.20 time: 0.192292 May 12 17:18:38.521267 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 213/430] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:38 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1749 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:39.184082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-8ea64dc5-2e8c-4795-a3ab-e5f30068bba0 req-e98ba26a-f888-4e29-aeab-d4b5b4113ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef", "tag": "e25fed55-18b6-4d75-bd0e-374461b42fe4"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:39.195203 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-8ea64dc5-2e8c-4795-a3ab-e5f30068bba0 req-e98ba26a-f888-4e29-aeab-d4b5b4113ec3 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:39.196210 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-8ea64dc5-2e8c-4795-a3ab-e5f30068bba0 req-e98ba26a-f888-4e29-aeab-d4b5b4113ec3 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:39.199080 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:18:39.199702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:18:39.200345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:18:39.200909 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:18:39.201469 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:18:39.209893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-8ea64dc5-2e8c-4795-a3ab-e5f30068bba0 req-e98ba26a-f888-4e29-aeab-d4b5b4113ec3 service nova] Creating event network-changed:e25fed55-18b6-4d75-bd0e-374461b42fe4 for instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef on hv-cinder-84159 May 12 17:18:39.212427 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:39.212875 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:39.213825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:39.214264 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:39.217925 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-8ea64dc5-2e8c-4795-a3ab-e5f30068bba0 req-e98ba26a-f888-4e29-aeab-d4b5b4113ec3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040775 May 12 17:18:39.219746 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 214/431] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:18:39.236868 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Getting quotas for project 25bc4c2d7eb345d8a531f74b42d0fb91. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:18:39.243261 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Getting quotas for user 35ca5db0a81843df923602a6616fdeec and project 25bc4c2d7eb345d8a531f74b42d0fb91. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:18:39.267913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:18:39.271226 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:18:39.328009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-93bccc23-e5c2-4e21-be3f-56973a603d96 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917005 May 12 17:18:39.329860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 218/432] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:18:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:18:39.341661 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8faa4556-fc19-47f7-8802-10b8a9e357d2 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:39.343059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8faa4556-fc19-47f7-8802-10b8a9e357d2 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:39.444616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8faa4556-fc19-47f7-8802-10b8a9e357d2 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:39.455405 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8faa4556-fc19-47f7-8802-10b8a9e357d2 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1214 microversion: 2.1 time: 0.119761 May 12 17:18:39.457017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 215/433] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:39 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:18:39.541737 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:39.542818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:39.552074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:39.552672 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:39.554004 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:39.554653 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:39.704788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:39.714629 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:39.716404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:39.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-42381c8d-d790-4cf7-8d16-baf09242bf81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1751 microversion: 2.20 time: 0.182133 May 12 17:18:39.718827 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 219/434] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:39 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:40.473502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:40.474459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:40.483512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:40.483978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:40.484863 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:40.485307 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:40.583544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:40.596191 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1f20d5f2-7382-4e92-819a-7d80719d1540 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1274 microversion: 2.1 time: 0.127502 May 12 17:18:40.597830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 216/435] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:40 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:40.738070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:40.738730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:40.745048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:40.745497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:40.746253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:40.746713 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:40.884187 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:40.893070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:40.894590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:40.895735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b68770f6-eb11-4ffa-97c0-ad7496f7d3aa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.161626 May 12 17:18:40.896289 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 220/436] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:40 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:41.615544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:41.616238 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:41.622775 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:41.623222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:41.623991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:41.624404 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:41.895538 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:41.903494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7c6164ac-ce72-436f-9d36-efd248c0140b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.291936 May 12 17:18:41.904157 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 217/437] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:41 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:41.915494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:41.916223 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:41.922109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:41.922675 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:41.923444 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:41.923875 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:42.060938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:42.070083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:42.072203 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:42.073375 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-268ab8c5-83a5-4ebc-a932-3ab096e0aa11 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.162199 May 12 17:18:42.073930 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 221/438] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:41 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:42.559233 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-a4e45b9c-3ac9-478e-a02d-81dfde494c8e req-f1a2120e-1ee9-4a7c-a1a6-b7229af7d70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6e18d3-80b9-4f10-bd7f-e880b328a4b3", "tag": "14491982-577f-4045-a9ef-f3cf2ad8285e"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:18:42.568402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a4e45b9c-3ac9-478e-a02d-81dfde494c8e req-f1a2120e-1ee9-4a7c-a1a6-b7229af7d70f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:42.569102 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a4e45b9c-3ac9-478e-a02d-81dfde494c8e req-f1a2120e-1ee9-4a7c-a1a6-b7229af7d70f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:42.580612 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-a4e45b9c-3ac9-478e-a02d-81dfde494c8e req-f1a2120e-1ee9-4a7c-a1a6-b7229af7d70f service nova] Creating event network-changed:14491982-577f-4045-a9ef-f3cf2ad8285e for instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 on hv-cinder-84159 May 12 17:18:42.586182 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-a4e45b9c-3ac9-478e-a02d-81dfde494c8e req-f1a2120e-1ee9-4a7c-a1a6-b7229af7d70f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030640 May 12 17:18:42.586459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 218/439] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:18:42.921913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:42.922989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:42.929210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:42.929676 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:42.930854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:42.931285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:43.066632 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:43.074091 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b1fcefd4-36e6-4782-88f9-0c51f3ef3d95 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.156681 May 12 17:18:43.074999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 222/440] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:42 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:43.093584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:43.094407 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:43.100761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:43.101207 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:43.102672 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:43.103106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:43.242610 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:43.252181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:43.253740 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:43.255091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-67e76c79-3aa8-40d2-9417-bb1669c60044 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.166139 May 12 17:18:43.255658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 219/441] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:43 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:44.090912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:44.091518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:44.097732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:44.098208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:44.099004 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:44.099464 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:44.233065 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:44.241227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-447e2cec-a808-440f-8bb3-b9f6cb287dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.154225 May 12 17:18:44.241804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 223/442] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:44 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:44.275174 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:44.276154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:44.283513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:44.284340 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:44.285365 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:44.286084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:44.422040 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:44.431787 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:44.433609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:44.434970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7b134b89-1af8-40f9-921e-619b1fa14729 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.163800 May 12 17:18:44.444520 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 220/443] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:44 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:45.258304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:45.258966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:45.265192 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:45.265941 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:45.267268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:45.267924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:45.445109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:45.453399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:45.453974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c365b5e7-3a97-4d15-aa0f-089caff6703b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.199101 May 12 17:18:45.454094 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:45.460381 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:45.460828 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:45.461584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:45.462942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:45.463162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 224/444] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:45 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:45.604375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:45.613609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:45.615212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:45.616418 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c63b2cd6-3503-432a-bab2-33b54beec71e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.167016 May 12 17:18:45.616973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 221/445] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:45 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:18:46.470379 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:46.471223 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:46.477010 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:46.477509 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:46.478310 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:46.478773 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:46.613443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:46.621938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-dead4eae-fdaf-4b4b-8a5a-bbc6e663c6f1 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.155439 May 12 17:18:46.622545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 225/446] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:46 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:46.635351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:46.635940 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:46.642295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:46.642785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:46.643558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:46.643990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:46.776122 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:46.786227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:46.788030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:46.789190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-21e3282a-7669-4ae4-aa65-cb78def170e6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.158034 May 12 17:18:46.789747 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 222/447] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:46 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:47.639810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:47.640403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:47.647157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:47.647611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:47.648388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:47.648824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:47.785054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:47.793122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0ac81f0d-3148-45fb-9e8e-63e9cfe4b80c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.157370 May 12 17:18:47.793898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 226/448] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:47 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:47.808533 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:47.809353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:47.815816 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:47.816257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:47.817016 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:47.817441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:47.951656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:47.960748 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:47.962378 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:47.963580 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b815b1c0-d99c-467f-84bb-d279b65a0315 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.159679 May 12 17:18:47.964333 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 223/449] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:47 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:48.810281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:48.811015 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:48.816877 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:48.817400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:48.818214 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:48.818671 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:48.961353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:48.969707 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-df2dbfe5-996a-4806-80c0-b5284f8cb218 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.163808 May 12 17:18:48.970318 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 227/450] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:48 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:48.982369 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:48.983351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:48.990118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:48.990629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:48.991410 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:48.991856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:49.121580 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:49.129822 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:49.131340 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:49.132741 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c01eb1dc-d38f-4771-be93-428fab3b0038 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.155053 May 12 17:18:49.133297 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 224/451] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:48 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:49.988862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:49.989790 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:49.997335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:49.997793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:49.998686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:49.999138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:50.130255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:50.138583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e18b5694-f946-4f02-92a0-15ae8b2263af tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.153462 May 12 17:18:50.139094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 228/452] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:49 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:50.151522 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:50.152145 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:50.158158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:50.158645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:50.159409 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:50.159834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:50.296333 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:50.305301 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:50.307451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:50.308713 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c5b29e48-47f8-4da5-9929-a5a1f3443e93 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.161788 May 12 17:18:50.309349 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 225/453] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:50 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:51.156325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:51.156899 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:51.163419 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:51.163866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:51.164632 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:51.165622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:51.300364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:51.308430 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-20834880-d280-4719-bf4e-0ea5f74a984d tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.156009 May 12 17:18:51.309388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 229/454] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:51 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:51.326704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:51.327298 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:51.333979 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:51.334445 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:51.335203 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:51.335627 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:51.485344 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:51.493462 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:51.499222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:51.499222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-92be0e6a-b108-4da7-873a-f4f60055082b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.173375 May 12 17:18:51.499222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 226/455] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:51 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:52.324999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:52.325584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:52.331468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:52.331901 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:52.332642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:52.333065 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:52.470247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:52.478096 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8dde5ece-72d0-4acf-8c9f-f5526085a67e tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.156430 May 12 17:18:52.478690 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 230/456] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:52 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:52.514719 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:52.515397 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:52.521793 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:52.522253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:52.523023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:52.523450 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:52.653814 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:52.661954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:52.663963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:52.665694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e91c2d3c-dcff-477f-a51b-7735e8400163 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.154691 May 12 17:18:52.666251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 227/457] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:52 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:53.495822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:53.496378 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:53.502238 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:53.502711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:53.503463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:53.503898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:53.630233 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:53.638227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-636f732e-ad87-48db-bbdd-fd7decad9392 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.146919 May 12 17:18:53.638827 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 231/458] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:53 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:53.684289 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:53.684892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:53.691367 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:53.691824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:53.692588 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:53.693053 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:53.824317 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:53.833429 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:53.837034 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:53.838546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-69d0d5c5-52c9-44d0-8e41-5c697029c4cd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.158785 May 12 17:18:53.839427 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 228/459] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:53 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:54.655552 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:54.656339 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:54.662170 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:54.662649 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:54.663405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:54.663826 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:54.790643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:54.797814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-91a0d294-4e42-486e-b393-12516812556b tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.146216 May 12 17:18:54.798384 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 232/460] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:54 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:54.856466 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:54.857093 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:54.863405 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:54.863853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:54.864620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:54.865059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:54.990902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:54.999322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:55.000806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:55.001934 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b61435f8-d318-4f71-b298-2206f2b7629d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.149386 May 12 17:18:55.002505 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 229/461] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:54 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:55.814969 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:55.815579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:55.822018 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:55.822477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:55.823235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:55.823656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:55.951243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:55.958661 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b48b137b-f1b3-49ff-b655-d34fa495baad tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.147474 May 12 17:18:55.959351 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 233/462] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:55 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:56.021071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:56.021777 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:56.028121 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:56.028640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:56.029461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:56.029894 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:56.232540 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:56.240825 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:56.242304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:56.244849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-44bc1c65-c436-49cb-89dc-be0651e2c907 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.227735 May 12 17:18:56.245795 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 230/463] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:56 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:56.975916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:56.976519 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:56.982385 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:56.982869 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:56.983627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:56.984061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:57.108736 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:57.116051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bf03f41d-3c90-4795-a4b5-b494f7347036 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.143912 May 12 17:18:57.116616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 234/464] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:56 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:57.266817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:57.267523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:57.273895 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:57.274371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:57.275189 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:57.275591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:57.405182 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:57.413444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:57.415359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:57.416502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e55982a7-2113-49fd-9bb4-738e9a2c580f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.153609 May 12 17:18:57.417061 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 231/465] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:57 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:58.133212 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:58.133873 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:58.139892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:58.140271 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:58.141026 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:58.141472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:58.278341 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:58.285509 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f4d13e38-b336-4467-85ef-22ceaf3c0dda tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.156400 May 12 17:18:58.286074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 235/466] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:58 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:58.434628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:58.435158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:58.441479 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:58.441925 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:58.442807 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:58.443244 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:58.573722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:58.581845 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:58.583393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:58.584541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ae0cd546-f2c3-479f-b66e-78e7645b1316 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.154038 May 12 17:18:58.585102 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 232/467] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:58 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:18:59.302180 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:59.302826 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:59.309226 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:59.309667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:59.310411 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:59.310886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:59.437678 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:59.444905 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c774e4db-d80d-4749-ac18-71dca09cf62f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.146528 May 12 17:18:59.445505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 236/468] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:18:59 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:18:59.603382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:18:59.603886 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:18:59.610160 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:59.610722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:59.611485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:18:59.611914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:18:59.735387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:59.743492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:59.744990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:18:59.746139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-83e1ba71-7127-440a-a09f-099fbee1ee4a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.147378 May 12 17:18:59.746714 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 233/469] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:18:59 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:00.250457 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-82dc7181-9760-46e3-bfd1-8297be3c9545 req-a5a5d5bb-38ad-419f-b9a8-89b45eeb94a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6e18d3-80b9-4f10-bd7f-e880b328a4b3", "name": "network-vif-plugged", "status": "completed", "tag": "14491982-577f-4045-a9ef-f3cf2ad8285e"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:00.259026 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-82dc7181-9760-46e3-bfd1-8297be3c9545 req-a5a5d5bb-38ad-419f-b9a8-89b45eeb94a1 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:00.259518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-82dc7181-9760-46e3-bfd1-8297be3c9545 req-a5a5d5bb-38ad-419f-b9a8-89b45eeb94a1 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:00.270869 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-82dc7181-9760-46e3-bfd1-8297be3c9545 req-a5a5d5bb-38ad-419f-b9a8-89b45eeb94a1 service nova] Creating event network-vif-plugged:14491982-577f-4045-a9ef-f3cf2ad8285e for instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 on hv-cinder-84159 May 12 17:19:00.276355 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-82dc7181-9760-46e3-bfd1-8297be3c9545 req-a5a5d5bb-38ad-419f-b9a8-89b45eeb94a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 May 12 17:19:00.276937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 237/470] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:19:00.461260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:00.462371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:00.468548 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:00.468989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:00.469735 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:00.470165 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:00.594686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:00.601880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-067717e5-9a15-481a-a75e-720bfaee5c55 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.144486 May 12 17:19:00.602616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 234/471] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:00 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:00.765893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:00.766636 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:00.772612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:00.773055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:00.774558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:00.775155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:00.903022 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:00.911224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:00.912723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:00.913869 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-290f834e-b1c4-40de-a7a0-900b3714f491 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.152553 May 12 17:19:00.914459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 238/472] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:00 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:01.618544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:01.619143 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:01.625417 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:01.625868 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:01.626660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:01.627088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:01.752927 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:01.760515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-81ea2343-ab5f-42e8-8250-e66b114cf63f tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1314 microversion: 2.1 time: 0.145813 May 12 17:19:01.762578 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 235/473] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:01 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:01.931692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:01.932290 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:01.938151 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:01.938626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:01.939373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:01.939797 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:02.066293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:02.075000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:02.076493 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:02.077627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c7f18c24-72b8-49c3-8fac-466b27c3061c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.149781 May 12 17:19:02.078183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 239/474] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:01 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:02.777153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:02.777755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:02.784186 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:02.784638 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:02.785403 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:02.785837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:02.912472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:02.920234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-095c97c3-6e89-4da3-b661-88e77d617cf4 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1499 microversion: 2.1 time: 0.147051 May 12 17:19:02.920809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 236/475] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:02 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1499 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:03.095682 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:03.096271 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:03.102846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:03.103300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:03.104068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:03.104498 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:03.238353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:03.247112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:03.248609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:03.249753 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-55176882-dd2a-4cb4-88bf-c5462098ba97 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.158085 May 12 17:19:03.250314 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 240/476] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:03 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:03.451336 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:03.451829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:03.457706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:03.458153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:03.458952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:03.459388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:03.483188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:19:03.555513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f84b5636-edbc-4904-a3df-6b83d57b0989 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 204 len: 0 microversion: 2.1 time: 0.107720 May 12 17:19:03.556106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 237/477] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:19:03 2022] DELETE /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:19:03.564740 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:03.565457 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:03.571992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:03.572441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:03.573217 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:03.573636 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:03.697355 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:03.704505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c211820f-f4c0-4117-8ff1-07724d44df9a tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1505 microversion: 2.1 time: 0.143936 May 12 17:19:03.705083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 241/478] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:03 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1505 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:04.269028 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:04.269734 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:04.276035 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:04.276492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:04.277264 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:04.277721 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:04.278720 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-d7ff012c-7f06-48dd-83ca-cb1ff6b1a9a6 req-65e64ea3-b54f-4371-898a-063a59b9005e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "name": "network-vif-plugged", "status": "completed", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:04.287628 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-d7ff012c-7f06-48dd-83ca-cb1ff6b1a9a6 req-65e64ea3-b54f-4371-898a-063a59b9005e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:04.288059 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-d7ff012c-7f06-48dd-83ca-cb1ff6b1a9a6 req-65e64ea3-b54f-4371-898a-063a59b9005e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:04.301673 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-d7ff012c-7f06-48dd-83ca-cb1ff6b1a9a6 req-65e64ea3-b54f-4371-898a-063a59b9005e service nova] Creating event network-vif-plugged:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:19:04.307438 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-d7ff012c-7f06-48dd-83ca-cb1ff6b1a9a6 req-65e64ea3-b54f-4371-898a-063a59b9005e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032261 May 12 17:19:04.308388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 242/479] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:19:04.411005 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:04.419158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:04.420652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:04.421797 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-cd67cc66-b635-4f44-a000-40ed82f1d1d9 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.157305 May 12 17:19:04.422356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 238/480] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:04 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:04.722518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:04.723155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:04.729256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:04.729704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:04.730550 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:04.730988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:04.859605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:04.866718 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bc92c024-9c69-450c-b38a-1fa76b915937 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1505 microversion: 2.1 time: 0.148495 May 12 17:19:04.867315 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 243/481] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:04 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:05.440337 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:05.440933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:05.447980 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:05.448421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:05.449184 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:05.449593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:05.578025 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:05.586146 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:05.587690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:05.588831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d0cff928-e987-4ecf-a3bb-d99fef6f7ded tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.152539 May 12 17:19:05.589382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 239/482] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:05 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:05.888925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:05.889529 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:05.895314 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:05.895752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:05.896530 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:05.896984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:06.022223 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:06.030110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-13a1cb21-e261-49c8-bf4a-40bcac33cbac tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1505 microversion: 2.1 time: 0.145242 May 12 17:19:06.030699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 244/483] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:05 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:06.304841 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-f0a8b85a-03d5-4067-9f73-60329871edb7 req-3f04c098-6d33-4d06-b321-747b23c82c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6e18d3-80b9-4f10-bd7f-e880b328a4b3", "name": "network-vif-deleted", "tag": "14491982-577f-4045-a9ef-f3cf2ad8285e"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:06.315085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f0a8b85a-03d5-4067-9f73-60329871edb7 req-3f04c098-6d33-4d06-b321-747b23c82c7c service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:06.315708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f0a8b85a-03d5-4067-9f73-60329871edb7 req-3f04c098-6d33-4d06-b321-747b23c82c7c service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:06.327748 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-f0a8b85a-03d5-4067-9f73-60329871edb7 req-3f04c098-6d33-4d06-b321-747b23c82c7c service nova] Creating event network-vif-deleted:14491982-577f-4045-a9ef-f3cf2ad8285e for instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 on hv-cinder-84159 May 12 17:19:06.333410 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-f0a8b85a-03d5-4067-9f73-60329871edb7 req-3f04c098-6d33-4d06-b321-747b23c82c7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 May 12 17:19:06.334007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 240/484] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:19:06.607515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:06.608112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:06.614037 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:06.614505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:06.615250 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:06.615673 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:06.741772 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:06.750491 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:06.751987 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:06.753864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8aae23a0-2774-41eb-b832-6bf84edeb101 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.149560 May 12 17:19:06.753864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 245/485] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:06 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:07.047275 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:07.047975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:07.054575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:07.055030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:07.055792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:07.056226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:07.085308 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:07.085756 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:07.086731 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lazy-loading 'fault' on Instance uuid 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:19:07.134085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ca5db0a81843df923602a6616fdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25bc4c2d7eb345d8a531f74b42d0fb91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:07.141611 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d42848a5-174c-463c-a95d-cd8038636539 tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 200 len: 1304 microversion: 2.1 time: 0.098528 May 12 17:19:07.142105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 241/486] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:07 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:07.770999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:07.771600 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:07.777347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:07.777774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:07.778814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:07.779243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:07.912531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:07.921333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:07.922833 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:07.923974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6a08a972-fbd3-4400-932c-50229c0da127 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1807 microversion: 2.20 time: 0.156819 May 12 17:19:07.924529 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 246/487] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:07 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:08.159742 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:08.160618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] [instance: 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:08.167479 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:08.167959 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:08.168737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:08.169164 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:08.182880 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] HTTP exception thrown: Instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 could not be found. May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Request method failure captured: May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 HTTP/1.1 May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUFRgXehFvYe5zpYdUu0UvdkDR8PKa3XnxbumTx5l5-8sqMt-l1_xpAHK_l__iAlENzaI-Sq7UV4jUg9oLD7xPG9OmAp2zbLIW5tk4pzY-80yaj-Thlf0h7iGcRmqpHn8TOKSaiznsxCi78XAt7UWovXH7wiab59qugSuzc5aslPm0s May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 25bc4c2d7eb345d8a531f74b42d0fb91 May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesActionsTest-310690744 May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:19:08.184535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25bc4c2d7eb345d8a531f74b42d0fb91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesActionsTest-310690744 May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 25bc4c2d7eb345d8a531f74b42d0fb91 May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesActionsTest-310690744 May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesActionsTest-310690744-project May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 35ca5db0a81843df923602a6616fdeec May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesActionsTest-310690744-project May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 could not be found. May 12 17:19:08.186082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '3f6e18d3-80b9-4f10-bd7f-e880b328a4b3'} May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 could not be found. May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:19:08.186919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 could not be found. May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 could not be found. May 12 17:19:08.188196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:19:08.189386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] Returning 404 to user: Instance 3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:19:08.189386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-602ce697-fb0f-4035-a9b0-e954d153d02c tempest-VolumesActionsTest-310690744 tempest-VolumesActionsTest-310690744-project] 10.222.0.23 "GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3" status: 404 len: 111 microversion: 2.1 time: 0.030690 May 12 17:19:08.189386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 242/488] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:08 2022] GET /compute/v2.1/servers/3f6e18d3-80b9-4f10-bd7f-e880b328a4b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:19:08.941533 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:08.942143 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:08.948107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:08.948552 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:08.949306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:08.949737 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:09.078005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:09.086779 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:09.088291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:09.089475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4774f277-7489-46f5-b872-e11a7d6d2e86 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1794 microversion: 2.20 time: 0.151815 May 12 17:19:09.090032 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 247/489] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:08 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:31.730323 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:31.730900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:31.736839 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:31.737295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:31.738055 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:31.738514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:31.858539 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lazy-loading 'services' on Instance uuid 878603bd-9524-4a76-88c3-463a2f09910f {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:19:31.970229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b13e1ef8-1a53-4b3f-ae99-3d87d5519b16 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-volume_attachments/a28b49d4-a43f-4b2d-a98c-d7381303b62f" status: 202 len: 0 microversion: 2.1 time: 0.243728 May 12 17:19:31.970918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 243/490] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:19:31 2022] DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-volume_attachments/a28b49d4-a43f-4b2d-a98c-d7381303b62f => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:19:33.081175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-fd2a5659-2bb7-45f8-8859-8092074e8311 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:33.088302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fd2a5659-2bb7-45f8-8859-8092074e8311 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:33.088753 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fd2a5659-2bb7-45f8-8859-8092074e8311 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:33.112870 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-fd2a5659-2bb7-45f8-8859-8092074e8311 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Going to try to stop instance {{(pid=117075) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 17:19:33.162891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-fd2a5659-2bb7-45f8-8859-8092074e8311 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action" status: 202 len: 0 microversion: 2.1 time: 0.085278 May 12 17:19:33.164433 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 248/491] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:19:33 2022] POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:19:33.172989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:33.173670 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:33.180487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:33.180870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:33.181817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:33.182443 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:33.319512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:33.326835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-02b1d958-63bb-4922-a72e-a36287893165 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.158192 May 12 17:19:33.327399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 244/492] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:33 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:34.292610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f21825e8-0707-4f99-8cb5-20b4da6f9a61"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:34.293780 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:34.299962 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:34.300404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:34.301163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:34.301662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:34.343826 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:34.344453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:34.351003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:34.351483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:34.352302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:34.352779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:34.489616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:34.498201 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-17a47437-cb13-47d3-ac38-096eeb4ea420 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.158114 May 12 17:19:34.498809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 245/493] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:34 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:34.552102 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-15f9dc0d-cda5-42e7-b1fe-27b7495cad44 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263729 May 12 17:19:34.552791 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 249/494] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:19:34 2022] POST /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:19:35.516900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:35.517504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:35.524387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:35.524835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:35.525589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:35.526020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:35.657372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:35.665262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b929f407-f073-4f17-a398-2dfd65d4fac8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.152153 May 12 17:19:35.666295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 246/495] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:35 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:36.684269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:36.685600 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:36.694205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:36.694928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:36.695854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:36.696439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:36.852126 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:36.859670 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a7be87d4-7587-4189-8426-fb9124df158e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.180668 May 12 17:19:36.860242 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 250/496] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:36 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:37.876381 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:37.876987 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:37.884323 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:37.884766 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:37.885542 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:37.886411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:38.022371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:38.025993 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e1379cda-b790-4f21-af6c-d044b73cffc5 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.153420 May 12 17:19:38.026882 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 247/497] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:37 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:39.042837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:39.043349 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:39.049583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:39.050029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:39.050866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:39.051309 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:39.184989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:39.192217 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d58e1c09-3a7f-4202-82bf-d2de1d841e62 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.153239 May 12 17:19:39.192779 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 251/498] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:39 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:40.209520 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:40.210147 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:40.217005 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:40.217447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:40.218196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:40.218653 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:40.342574 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:40.349768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-400285e4-02fc-4a16-9688-c11bc4b4d64f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.144087 May 12 17:19:40.350321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 248/499] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:40 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:41.366648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:41.367251 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:41.373611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:41.374054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:41.374840 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:41.375276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:41.499592 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:41.506895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8a80cc4c-aeb7-43e0-9e03-51e0fe6ea9c0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.144068 May 12 17:19:41.507969 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 252/500] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:41 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:42.523655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:42.524403 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:42.530891 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:42.531347 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:42.532276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:42.532713 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:42.675209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:42.683618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1693717c-6eae-4b78-9d3f-dea9119396eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1677 microversion: 2.1 time: 0.163765 May 12 17:19:42.694452 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 249/501] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:42 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:43.096858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:43.097865 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:43.104739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.105184 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.105936 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.106367 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.127667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lazy-loading 'flavor' on Instance uuid 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:19:43.247020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d6e923bf-e47f-4fcd-92ac-06d0b5f5a8f0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/action" status: 200 len: 32 microversion: 2.1 time: 0.153940 May 12 17:19:43.247723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 253/502] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:19:43 2022] POST /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:19:43.256706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:43.258055 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:43.264061 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.264506 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.265295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.265716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.422964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:43.430617 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-08a69fc5-5847-437e-9ee8-0ce487b83c38 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.177769 May 12 17:19:43.431176 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 250/503] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:43 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:43.701824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:43.702539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:43.708867 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.709309 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.710071 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.710647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.854446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:43.863832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1dc5723e-6c4e-42d3-9de2-e1d29c51e3a7 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1654 microversion: 2.1 time: 0.165975 May 12 17:19:43.876258 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 254/504] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:43 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:43.881585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-efb7c22d-b8b5-4f38-8d5c-a14824c5f4d2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:43.889323 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-efb7c22d-b8b5-4f38-8d5c-a14824c5f4d2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:43.889776 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-efb7c22d-b8b5-4f38-8d5c-a14824c5f4d2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:43.953920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-efb7c22d-b8b5-4f38-8d5c-a14824c5f4d2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Going to try to start instance {{(pid=117074) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 17:19:43.994524 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-efb7c22d-b8b5-4f38-8d5c-a14824c5f4d2 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action" status: 202 len: 0 microversion: 2.1 time: 0.116703 May 12 17:19:43.995120 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 251/505] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:19:43 2022] POST /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:19:44.003038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:44.003640 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:44.009762 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:44.010202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:44.010981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:44.011408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:44.144780 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:44.152526 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-15e97bbc-a269-4a95-95bb-6c2d3a638a4a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1663 microversion: 2.1 time: 0.153187 May 12 17:19:44.153097 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 255/506] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:43 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:44.448393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:44.449087 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:44.455401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:44.455849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:44.456613 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:44.457044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:44.672361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:44.680111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ef8a9d4d-9a99-4057-92db-f30ef4223c26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.236154 May 12 17:19:44.680680 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 252/507] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:44 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:45.169490 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:45.170090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:45.176382 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:45.176771 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:45.177526 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:45.177966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:45.319925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:45.328186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b6bd137e-a970-4063-a7d4-c3cf86625c8a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1663 microversion: 2.1 time: 0.162661 May 12 17:19:45.328783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 256/508] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:45 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:45.697263 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:45.697868 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:45.704056 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:45.704498 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:45.705247 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:45.705673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:45.828908 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:45.837348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-44140064-6e0e-4bb6-9d57-f9444f9e71ff tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.144024 May 12 17:19:45.837914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 253/509] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:45 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:46.345017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:46.345616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:46.352059 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:46.352508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:46.353268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:46.353732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:46.494467 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:46.502177 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0b0df235-61ff-4504-bef2-f4c8b848a19a tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1667 microversion: 2.1 time: 0.161068 May 12 17:19:46.502760 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 257/510] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:46 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:46.854562 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:46.855145 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:46.862288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:46.862848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:46.863671 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:46.864359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:47.001090 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:47.009098 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f20882a3-6ded-4c26-9340-4b59ae6f0204 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.158833 May 12 17:19:47.009656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 254/511] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:46 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:48.025760 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:48.026358 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:48.032658 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:48.033101 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:48.033848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:48.034276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:48.160941 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:48.168674 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e6e6515b-fcd2-4963-8ecb-f8c243bbbf66 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.147425 May 12 17:19:48.169235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 258/512] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:48 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:49.186218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:49.186796 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:49.193047 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:49.193493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:49.194248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:49.194712 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:49.323760 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:49.331614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-fc93b88a-5117-47b1-89d8-7a3e2a190a1c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.149188 May 12 17:19:49.336535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 255/513] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:49 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:50.348683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:50.349291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:50.355615 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:50.356067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:50.356830 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:50.357264 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:50.483978 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:50.492522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-52280a3b-08be-4e84-aed7-fc88e087d4f4 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.147609 May 12 17:19:50.493101 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 259/514] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:50 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:50.689913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:50.690468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:50.696485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:50.696931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:50.697686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:50.698113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:50.724888 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7434f8a3-8ccc-447a-b5ad-11f3af970c8e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments/c6f9b92f-6de0-4a85-a18f-6feb72ace1b3" status: 200 len: 194 microversion: 2.20 time: 0.038926 May 12 17:19:50.725442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 256/515] 10.222.0.23 () {60 vars in 1453 bytes} [Thu May 12 17:19:50 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments/c6f9b92f-6de0-4a85-a18f-6feb72ace1b3 => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:19:50.787294 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:50.787795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:50.795097 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:50.795687 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:50.796610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:50.797138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:50.918611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lazy-loading 'services' on Instance uuid 47998668-5296-4019-a02c-3c80e30ff266 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:19:51.030583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e68f89f3-1581-42cc-ba53-655cc6fd3112 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments/c6f9b92f-6de0-4a85-a18f-6feb72ace1b3" status: 202 len: 0 microversion: 2.20 time: 0.247788 May 12 17:19:51.031510 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 260/516] 10.222.0.23 () {60 vars in 1456 bytes} [Thu May 12 17:19:50 2022] DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments/c6f9b92f-6de0-4a85-a18f-6feb72ace1b3 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:19:51.040094 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:51.041095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:51.047435 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:51.048246 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:51.049402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:51.049850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:51.081769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f28c8dcf-7107-4be1-8dde-1cc3762d478f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046069 May 12 17:19:51.082626 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 257/517] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 12 17:19:51 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:19:51.512952 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:51.513649 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:51.519922 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:51.520390 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:51.521136 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:51.521572 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:51.679136 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:51.687324 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2fae6a77-75bd-4e83-a840-a58102d49728 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.178982 May 12 17:19:51.687902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 261/518] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:51 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:52.095391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:52.096244 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:52.102599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.103049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.103806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.104236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.131546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bdefd30a-0820-4f3a-9caa-fb0666055de6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040230 May 12 17:19:52.133008 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 258/519] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 12 17:19:52 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:52.189602 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:52.190092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:52.196003 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.196448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.197213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.197647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.221473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Going to try to terminate instance {{(pid=117075) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:19:52.315878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-72c00f22-b7b0-4cd3-ac84-5cea63df2c01 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 204 len: 0 microversion: 2.20 time: 0.131138 May 12 17:19:52.316568 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 262/520] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 12 17:19:52 2022] DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:19:52.324912 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:52.325515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:52.331398 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.331843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.332598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.333030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.462484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:52.470129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:52.471666 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:52.472811 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c52994e6-7c6d-41df-b7ac-7c2b880b6dbc tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.151786 May 12 17:19:52.473366 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 259/521] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:52 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:52.705572 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:52.706289 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:52.712465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.712914 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.713698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:52.714121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:52.844496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:52.853156 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-edf954e7-ff2e-4433-9695-5c2883ac8b9b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.151856 May 12 17:19:52.853739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 263/522] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:52 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:53.491385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:53.491989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:53.498277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:53.498758 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:53.499508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:53.499964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:53.628699 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:53.636620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:53.638117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:53.639297 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0cf46440-ea3c-4b94-be95-2953b71ea6e0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.151903 May 12 17:19:53.639855 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 260/523] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:53 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:53.870150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:53.870783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:53.877087 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:53.877535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:53.878292 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:53.878778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:54.016219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:54.023451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f7130164-c6a4-44ec-a08d-d7975d052c6e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.156372 May 12 17:19:54.024245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 264/524] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:53 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:54.658110 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:54.658690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:54.665091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:54.665529 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:54.666298 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:54.666760 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:54.904101 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:54.912023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:54.913429 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:54.914595 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4543d0e6-ea7e-4634-931a-60c177d7dd1a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 200 len: 1722 microversion: 2.20 time: 0.260492 May 12 17:19:54.915156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 261/525] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:54 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:55.040857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:55.041453 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:55.047620 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:55.048063 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:55.048818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:55.049245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:55.192111 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:55.200739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-cd9bfe02-912e-47ba-bbf2-16bdfaaf179a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.163825 May 12 17:19:55.201621 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 265/526] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:55 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:55.369393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-3bb26490-4f05-4d32-9277-f863c1689046 req-a5814010-8807-4cea-bc4c-e5446bdf2b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47998668-5296-4019-a02c-3c80e30ff266", "name": "network-vif-deleted", "tag": "83ec910a-00e4-4992-bde0-b3583158daf3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:55.381663 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-3bb26490-4f05-4d32-9277-f863c1689046 req-a5814010-8807-4cea-bc4c-e5446bdf2b86 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:55.382234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-3bb26490-4f05-4d32-9277-f863c1689046 req-a5814010-8807-4cea-bc4c-e5446bdf2b86 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:55.421566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-3bb26490-4f05-4d32-9277-f863c1689046 req-a5814010-8807-4cea-bc4c-e5446bdf2b86 service nova] Creating event network-vif-deleted:83ec910a-00e4-4992-bde0-b3583158daf3 for instance 47998668-5296-4019-a02c-3c80e30ff266 on hv-cinder-84159 May 12 17:19:55.429762 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-3bb26490-4f05-4d32-9277-f863c1689046 req-a5814010-8807-4cea-bc4c-e5446bdf2b86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067290 May 12 17:19:55.434755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 262/527] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:19:55.932860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:55.933619 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:55.939729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:55.940290 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:55.941163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:55.941702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:55.957894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] HTTP exception thrown: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Request method failure captured: May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 HTTP/1.1 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDQo9diWWCBJmUQ-j3les2qmEUE8lZTHF7p4GqdbI_b6s-P8sEh8yCjj6Twrc6C0hZ4CbLP8h6zXIyJ9T2j1pZLeLtjlxwii5iJkjjVAPSGQHagTBlvmjGk3b-G9IJlnHA0YeOSyr5JGjUFfXiAKotjJSSjzBcMhVBazz-npHdr0-A May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:19:55.959605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 39a6070dad2d4b0e8d9c4004a396a66e May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:19:55.961829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '47998668-5296-4019-a02c-3c80e30ff266'} May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:19:55.962838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:19:55.964313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:19:55.965668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Returning 404 to user: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:19:55.965946 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-81f5a30c-6498-4509-9e31-f41a7c491df4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 404 len: 111 microversion: 2.20 time: 0.037071 May 12 17:19:55.966620 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 266/528] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:55 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:19:55.975263 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-41ae59d6-d29c-47c6-8335-ba0115701824 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '.version_select at 0x7f78af49ce50>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:55.995095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-41ae59d6-d29c-47c6-8335-ba0115701824 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468601648" status: 204 len: 0 microversion: 2.20 time: 0.023885 May 12 17:19:55.995790 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 263/529] 10.222.0.23 () {60 vars in 1258 bytes} [Thu May 12 17:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468601648 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:19:56.219691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:56.220828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:56.229325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:56.230095 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:56.231087 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:56.232029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:56.458132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:56.466302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b2668a8d-c03a-49f8-8fea-6bfd53c2b5da tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.251605 May 12 17:19:56.466926 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 267/530] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:56 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:19:56.859594 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-874c3b32-458f-4ce4-8dbe-3de42b1878ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'create', calling method: .version_select at 0x7f78af556ca0>, body: {"keypair": {"name": "tempest-keypair-1962514658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMk7z+J8lPPT6Rwm1bl46DwwtosWu2PuUpjQtBgpNFFbjZySdBq2jb4Eyu47LUdVE8dUbb/V+Nqys5QyGGv1tQjDr5WEOnDvcfQcgqTIESHnW7ANpoEZP8SH2kG8qmB/Rw=="}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:56.878800 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-874c3b32-458f-4ce4-8dbe-3de42b1878ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'key_pairs'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:19:56.892381 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-874c3b32-458f-4ce4-8dbe-3de42b1878ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for user 39a6070dad2d4b0e8d9c4004a396a66e and project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'key_pairs'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:19:56.921544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-874c3b32-458f-4ce4-8dbe-3de42b1878ee tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.068818 May 12 17:19:56.922593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 264/531] 10.222.0.23 () {62 vars in 1199 bytes} [Thu May 12 17:19:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 17:19:57.483813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:57.485117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:57.491972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:57.492552 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:57.493326 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:57.493797 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:57.685578 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:57.694005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8b09a37f-e4c7-4345-92d0-897f008abf8a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.214221 May 12 17:19:57.695412 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 268/532] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:57 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:19:58.315937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-62488685", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77b21ff8-23c6-42d2-9321-6759378651ee"}], "security_groups": [{"name": "tempest-securitygroup--2092899800"}], "key_name": "tempest-keypair-1962514658", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:19:58.420394 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] validate_networks() for [('77b21ff8-23c6-42d2-9321-6759378651ee', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:19:58.712155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:58.712756 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:58.718920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:58.719367 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:58.720127 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:58.720560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:58.789136 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:19:58.789556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:19:58.790023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:19:58.790484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:19:58.790901 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:19:58.799996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:58.800440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:58.801229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:58.801687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:58.820537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:19:58.825023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Getting quotas for user 39a6070dad2d4b0e8d9c4004a396a66e and project 9f96cd34d1bc46b78a000e0b5af9d6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:19:58.836627 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:19:58.839023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:19:58.850290 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:58.859251 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-de4daa4a-20f4-41f1-8a87-8f71dd9c580e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.151432 May 12 17:19:58.859808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 269/533] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:58 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:19:58.887936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a50ebf31-dd52-4e75-af10-c78e045f894c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.576658 May 12 17:19:58.888611 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 265/534] 10.222.0.23 () {62 vars in 1187 bytes} [Thu May 12 17:19:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 17:19:58.899270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d61087f0-6232-42d0-97db-6ff22065252d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:58.899987 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d61087f0-6232-42d0-97db-6ff22065252d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:58.955930 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d61087f0-6232-42d0-97db-6ff22065252d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:58.963454 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d61087f0-6232-42d0-97db-6ff22065252d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:58.965057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d61087f0-6232-42d0-97db-6ff22065252d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:19:58.966303 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d61087f0-6232-42d0-97db-6ff22065252d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1280 microversion: 2.20 time: 0.071557 May 12 17:19:58.966898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 270/535] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:58 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:19:59.877821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:59.878620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:59.892704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:59.893433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:59.894309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:59.894869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:59.984372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:19:59.985464 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:19:59.994326 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:59.994871 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:19:59.995630 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:19:59.996057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:00.057630 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:00.060105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:00.065918 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:00.067723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:00.068347 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1ea45ffa-fc5b-4d99-94d8-7576bfbc359b tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.195154 May 12 17:20:00.068841 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bbfba3ef-f897-424e-8874-035bacda0861 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1338 microversion: 2.20 time: 0.089393 May 12 17:20:00.069773 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 266/536] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:19:59 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:00.079605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 271/537] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:19:59 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1338 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:20:01.086768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:01.088031 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:01.094456 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:01.094900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:01.095651 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:01.096101 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:01.096101 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:01.096270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:01.106121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:01.107760 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:01.108547 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:01.108977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:01.265505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:01.274306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:01.276012 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:01.277056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6f5a1182-c9b5-4a6c-af01-8e7e5e4d6495 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.194138 May 12 17:20:01.277813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 272/538] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:01 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:01.305014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:01.312909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7e5f8747-086f-4ecf-b94c-aee9a34ed93a tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.230731 May 12 17:20:01.322413 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 267/539] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:01 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:01.341911 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-a9f96dac-4b1d-489d-bc73-024ed7cb3441 req-5ddf2a68-4e1d-4387-8e3f-73df9a60c205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:01.352815 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-a9f96dac-4b1d-489d-bc73-024ed7cb3441 req-5ddf2a68-4e1d-4387-8e3f-73df9a60c205 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:01.353254 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-a9f96dac-4b1d-489d-bc73-024ed7cb3441 req-5ddf2a68-4e1d-4387-8e3f-73df9a60c205 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:01.367598 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-a9f96dac-4b1d-489d-bc73-024ed7cb3441 req-5ddf2a68-4e1d-4387-8e3f-73df9a60c205 service nova] Creating event network-changed:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:20:01.372948 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-a9f96dac-4b1d-489d-bc73-024ed7cb3441 req-5ddf2a68-4e1d-4387-8e3f-73df9a60c205 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034765 May 12 17:20:01.373557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 273/540] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:02.294868 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:02.295466 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:02.301595 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:02.302034 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:02.302810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:02.303238 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:02.330247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:02.330979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:02.338038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:02.338512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:02.339273 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:02.339703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:02.436625 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:02.444934 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:02.446454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:02.447565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6e540acc-cbdc-49a6-a854-844c8bed7bbf tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.156559 May 12 17:20:02.458496 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 268/541] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:02 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:02.485989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:02.494309 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-534f0392-d541-4681-a3a5-deba67d29e9e tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.168207 May 12 17:20:02.494907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 274/542] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:02 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:03.465884 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:03.466523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:03.472912 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:03.473363 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:03.474200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:03.474780 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:03.511829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:03.512694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:03.520247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:03.520773 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:03.521710 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:03.522132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:03.608352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:03.616964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:03.618536 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:03.619650 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-943c5151-f5a2-4f72-8e4e-a66e3de6fd46 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.157577 May 12 17:20:03.620207 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 269/543] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:03 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:03.661605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:03.671383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e4c59a17-70b2-4e76-af40-8c39e3aa0802 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.163738 May 12 17:20:03.672130 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 275/544] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:03 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:04.637859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:04.638473 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:04.644729 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:04.645172 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:04.645919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:04.646342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:04.689606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:04.690220 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:04.697667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:04.698112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:04.698907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:04.699336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:04.794307 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:04.802801 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:04.804854 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:04.805961 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-093345d4-d180-4a9e-810c-74d2f2825e36 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.172022 May 12 17:20:04.806557 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 270/545] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:04 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:04.829852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:04.837924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-481122d8-2515-4848-8671-4f3d1c02d388 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.152071 May 12 17:20:04.838587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 276/546] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:04 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:05.824473 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:05.825079 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:05.831421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:05.831871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:05.832627 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:05.833056 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:05.855745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:05.856358 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:05.862851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:05.863304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:05.864111 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:05.864554 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:05.963256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:05.971317 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:05.972824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:05.973930 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7b0d5800-0816-4b58-9a23-254e34f1a256 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.153424 May 12 17:20:05.974700 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 271/547] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:05 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:06.002965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:06.011396 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-688d67d5-7ad6-4651-911e-45bc6a985269 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1738 microversion: 2.1 time: 0.159506 May 12 17:20:06.011966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 277/548] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:05 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:06.657966 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-01d35c68-ac1b-4266-85df-a961028aff9b req-be645614-f9b2-45a0-beda-bbffed3a492b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "name": "network-vif-plugged", "status": "completed", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:06.666633 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-01d35c68-ac1b-4266-85df-a961028aff9b req-be645614-f9b2-45a0-beda-bbffed3a492b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:06.667074 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-01d35c68-ac1b-4266-85df-a961028aff9b req-be645614-f9b2-45a0-beda-bbffed3a492b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:06.678282 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-01d35c68-ac1b-4266-85df-a961028aff9b req-be645614-f9b2-45a0-beda-bbffed3a492b service nova] Creating event network-vif-plugged:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:20:06.683847 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-01d35c68-ac1b-4266-85df-a961028aff9b req-be645614-f9b2-45a0-beda-bbffed3a492b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029549 May 12 17:20:06.684465 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 272/549] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:06.991655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:06.992258 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:06.998547 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:06.998994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:06.999752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.000183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.029776 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:07.030493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:07.036522 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.036967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.037771 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.038930 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.150925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:07.161011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:07.163362 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:07.168337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a5bdf0a6-95d1-4d1b-a5c9-588f954fe0c1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.180471 May 12 17:20:07.169407 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 278/550] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:06 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:07.500432 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:07.509031 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-90e629c2-ef36-46ba-be08-b2889df625d0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1718 microversion: 2.1 time: 0.483841 May 12 17:20:07.509598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 273/551] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:07 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1718 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:07.612395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:07.612893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:07.623276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.623752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.624523 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.624954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.716897 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] HTTP exception thrown: Cannot 'detach_volume' instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef while it is in vm_state rescued May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Request method failure captured: May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments/f21825e8-0707-4f99-8cb5-20b4da6f9a61 HTTP/1.1 May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDbaoID1mXNalGPs8Oq4EVEG_oMbHWy9gLmpb4Pe6294BkPmlutnw9PSOScsq6PPOPIXjoUUFZgcVlQ1atTPoQdAyxxYF85WY84DoMVqpHEGfysHI9EE_bwXgIrjmZvSP7RyMEHE10MiCvSKdjSibzfxkXLIoOEGnPndR3MRdt_uuA May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 638166bec22640968de80cfeaeed437b May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:20:07.718543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/638166bec22640968de80cfeaeed437b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_638166bec22640968de80cfeaeed437b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 638166bec22640968de80cfeaeed437b May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 650969502a9f41e38066a7c269d84ab7 May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:20:07.719856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Cannot 'detach_volume' instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef while it is in vm_state rescued May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'server_id': '5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef', 'id': 'f21825e8-0707-4f99-8cb5-20b4da6f9a61'} May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:20:07.720522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef while it is in vm_state rescued May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef while it is in vm_state rescued May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:07.721958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Returning 409 to user: Cannot 'detach_volume' instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef while it is in vm_state rescued {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:20:07.723139 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c13d559f-9eb6-4c8a-abeb-3ae5f3a33387 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments/f21825e8-0707-4f99-8cb5-20b4da6f9a61" status: 409 len: 152 microversion: 2.1 time: 0.116895 May 12 17:20:07.723139 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 279/552] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:20:07 2022] DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments/f21825e8-0707-4f99-8cb5-20b4da6f9a61 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 17:20:07.728898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:07.729428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:07.735253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.735704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.736459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.736892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.799794 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e0f05804-173e-46d9-955b-2adc399529b2 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "POST /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/action" status: 202 len: 0 microversion: 2.1 time: 0.074639 May 12 17:20:07.804090 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 274/553] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:20:07 2022] POST /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:20:07.809253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:07.809858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:07.816371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.816816 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.817584 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:07.818022 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:07.946900 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:07.954721 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-908556be-0b5c-4e3a-b49d-0680d35ba980 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1726 microversion: 2.1 time: 0.149274 May 12 17:20:07.955285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 280/554] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:07 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:08.187146 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:08.187821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:08.194252 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:08.194777 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:08.195472 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:08.195898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:08.376650 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:08.385378 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:08.386905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:08.388077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1c9b7b24-6876-41b9-b23a-391a181fb4be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1406 microversion: 2.20 time: 0.205313 May 12 17:20:08.388750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 275/555] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:08 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:08.971888 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:08.972528 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:08.979494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:08.979937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:08.981452 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:08.981893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:09.127153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:09.145826 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-db6b95cf-b163-4533-a216-e82a3c82421d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1726 microversion: 2.1 time: 0.177066 May 12 17:20:09.146447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 281/556] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:08 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:09.406349 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:09.407621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:09.414918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:09.415375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:09.416153 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:09.416588 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:09.541338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:09.549151 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:09.550715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:09.551886 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-95cf1448-896d-4358-849f-26f40da1777d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1598 microversion: 2.20 time: 0.149699 May 12 17:20:09.552439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 276/557] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:09 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:09.569403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:09.569892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:09.575669 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:09.576112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:09.576862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:09.577291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:09.652363 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9e3c21f0-6533-4f9e-88f1-c1dcfd7f18a8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086734 May 12 17:20:09.652947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 282/558] 10.222.0.23 () {60 vars in 1315 bytes} [Thu May 12 17:20:09 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:20:10.164646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:10.165248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:10.172242 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:10.172694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:10.173467 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:10.173900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:10.305008 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:10.312876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b7c8b2c3-fa39-4238-b990-c3ddc3af2291 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1726 microversion: 2.1 time: 0.152691 May 12 17:20:10.313660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 277/559] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:10 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:10.825002 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-bd4be483-f2e5-4e66-9a48-c73ba4d706cc req-25e0fb5b-c015-4194-b10e-9872a02f3f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:10.833090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-bd4be483-f2e5-4e66-9a48-c73ba4d706cc req-25e0fb5b-c015-4194-b10e-9872a02f3f44 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:10.833616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-bd4be483-f2e5-4e66-9a48-c73ba4d706cc req-25e0fb5b-c015-4194-b10e-9872a02f3f44 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:10.844331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-bd4be483-f2e5-4e66-9a48-c73ba4d706cc req-25e0fb5b-c015-4194-b10e-9872a02f3f44 service nova] Creating event network-changed:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:20:10.849571 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-bd4be483-f2e5-4e66-9a48-c73ba4d706cc req-25e0fb5b-c015-4194-b10e-9872a02f3f44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028601 May 12 17:20:10.850622 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 283/560] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:11.330309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:11.331063 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:11.338022 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:11.338689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:11.339468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:11.339904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:11.551386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:11.559571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2e40ac88-734d-4da9-8f53-d7c57f1e2d5c tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1726 microversion: 2.1 time: 0.233023 May 12 17:20:11.560273 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 278/561] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:11 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:12.577976 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:12.578799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:12.585490 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:12.585931 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:12.586699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:12.587129 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:12.711611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:12.719419 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7373312e-91a8-4922-a2b0-d1ba3f8c5a72 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1732 microversion: 2.1 time: 0.146049 May 12 17:20:12.719987 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 284/562] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:12 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:12.735852 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:12.736342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:12.742963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:12.743409 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:12.744164 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:12.744595 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:12.823892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ace7cd31-62c9-48bd-bc73-68deab922cbb tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091810 May 12 17:20:12.824487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 279/563] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:20:12 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:13.714879 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-24ef5f05-aa80-4384-90cd-40cee03aca15 req-339561eb-eac2-4c3e-874b-fcdd516047ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef", "tag": "e25fed55-18b6-4d75-bd0e-374461b42fe4"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:13.723424 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-24ef5f05-aa80-4384-90cd-40cee03aca15 req-339561eb-eac2-4c3e-874b-fcdd516047ae service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:13.723949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-24ef5f05-aa80-4384-90cd-40cee03aca15 req-339561eb-eac2-4c3e-874b-fcdd516047ae service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:13.736167 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-24ef5f05-aa80-4384-90cd-40cee03aca15 req-339561eb-eac2-4c3e-874b-fcdd516047ae service nova] Creating event network-changed:e25fed55-18b6-4d75-bd0e-374461b42fe4 for instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef on hv-cinder-84159 May 12 17:20:13.746088 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-24ef5f05-aa80-4384-90cd-40cee03aca15 req-339561eb-eac2-4c3e-874b-fcdd516047ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 May 12 17:20:13.747448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 285/564] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:15.762502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-53f11170-ff3d-4555-92bb-5a92524d158d req-314e2e40-f1f1-4522-b09f-d3d5647bdf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef", "tag": "e25fed55-18b6-4d75-bd0e-374461b42fe4"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:15.770653 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-53f11170-ff3d-4555-92bb-5a92524d158d req-314e2e40-f1f1-4522-b09f-d3d5647bdf2a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:15.771087 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-53f11170-ff3d-4555-92bb-5a92524d158d req-314e2e40-f1f1-4522-b09f-d3d5647bdf2a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:15.783010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-53f11170-ff3d-4555-92bb-5a92524d158d req-314e2e40-f1f1-4522-b09f-d3d5647bdf2a service nova] Creating event network-changed:e25fed55-18b6-4d75-bd0e-374461b42fe4 for instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef on hv-cinder-84159 May 12 17:20:15.788218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-53f11170-ff3d-4555-92bb-5a92524d158d req-314e2e40-f1f1-4522-b09f-d3d5647bdf2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029712 May 12 17:20:15.788799 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 280/565] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:24.896219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:24.897750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:24.903846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:24.904295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:24.905063 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:24.905498 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:24.933249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e1d22277-05be-461d-810b-08860dd57a79 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041782 May 12 17:20:24.933786 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 286/566] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:20:24 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:20:24.990467 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:24.991054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:24.996989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:24.997439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:24.998197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:24.998662 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:25.022939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:20:25.093376 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-89fabac6-6e0a-4106-bb62-97a4a71517a9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 204 len: 0 microversion: 2.1 time: 0.107412 May 12 17:20:25.093962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 281/567] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:20:24 2022] DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:20:25.111583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:25.112123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:25.118209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:25.118698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:25.119463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:25.119896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:25.249885 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:25.257908 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f0f8bd1d-1575-4cc4-97fb-3c3fc8ad779c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1673 microversion: 2.1 time: 0.158638 May 12 17:20:25.258496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 287/568] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:25 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:26.275995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:26.276694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:26.283026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:26.283474 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:26.284236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:26.284670 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:26.414098 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:26.421357 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bfa181d4-e43d-4df7-bb94-f19f1d014305 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1673 microversion: 2.1 time: 0.149589 May 12 17:20:26.421914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 282/569] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:26 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:27.438203 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:27.438838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:27.447289 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:27.447734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:27.448496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:27.448929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:27.573596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:27.581088 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-213b114a-f82b-4943-a535-c79630242936 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1673 microversion: 2.1 time: 0.146659 May 12 17:20:27.581655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 288/570] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:27 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:28.597645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:28.599078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:28.607086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:28.607527 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:28.608335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:28.608936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:28.619991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-9c270525-f322-4c93-8055-c12414f25bc8 req-ec3d9ef8-accb-4d27-97e1-5f614ebd3b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878603bd-9524-4a76-88c3-463a2f09910f", "name": "network-vif-deleted", "tag": "b977622b-d460-4133-b674-446f064230f1"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:28.628545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-9c270525-f322-4c93-8055-c12414f25bc8 req-ec3d9ef8-accb-4d27-97e1-5f614ebd3b90 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:28.629370 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-9c270525-f322-4c93-8055-c12414f25bc8 req-ec3d9ef8-accb-4d27-97e1-5f614ebd3b90 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:28.648795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-9c270525-f322-4c93-8055-c12414f25bc8 req-ec3d9ef8-accb-4d27-97e1-5f614ebd3b90 service nova] Creating event network-vif-deleted:b977622b-d460-4133-b674-446f064230f1 for instance 878603bd-9524-4a76-88c3-463a2f09910f on hv-cinder-84159 May 12 17:20:28.654499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-9c270525-f322-4c93-8055-c12414f25bc8 req-ec3d9ef8-accb-4d27-97e1-5f614ebd3b90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041116 May 12 17:20:28.655832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 289/571] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:20:28.702539 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:28.710869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-398c6ff7-e208-459f-b797-da67356fd25b tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 200 len: 1605 microversion: 2.1 time: 0.116918 May 12 17:20:28.711740 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 283/572] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:28 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 1605 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:29.731202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:29.731793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:29.737951 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:29.738386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:29.739171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:29.739599 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:29.754285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] HTTP exception thrown: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Request method failure captured: May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f HTTP/1.1 May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDgpFJqkbVgJgsBO1cnfbpqfukclWZ9WWrcG0UzVUwHKmed9ygGhMkB9mvs1NU4MDu12PHyPWZhFvuq-0mdT_rMGZQFBUFTKT7S6Zwd1GR4zxcLt7561WJaYYPD3hPe16ZpvbLgmKcKD8H3DzvdeFqPWzcNu14I5tde20ijWI0pitk May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:20:29.756054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeTestJSON-1241902557 May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: f73a65ebe334405099f7a4f95c4a4df6 May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:20:29.757937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '878603bd-9524-4a76-88c3-463a2f09910f'} May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:20:29.759039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:20:29.760285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:20:29.761648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Returning 404 to user: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:20:29.761648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f2cbeb39-e872-4011-af61-7e1708d5d0fe tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 404 len: 111 microversion: 2.1 time: 0.031389 May 12 17:20:29.761648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 290/573] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:29 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:20:29.767671 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e6c10f09-bcb9-46ee-a01f-92ecfb2268ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '.version_select at 0x7f78afda63a0>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:29.786286 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e6c10f09-bcb9-46ee-a01f-92ecfb2268ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039403169" status: 202 len: 0 microversion: 2.1 time: 0.022390 May 12 17:20:29.787494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 284/574] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 12 17:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039403169 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:20:30.397509 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-58f54236-ea5d-476a-82fe-d60e1d7b456c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: .version_select at 0x7f78aec67af0>, body: {"keypair": {"name": "tempest-keypair-2113323179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhpVzSGQVdygDH3ePlg8dwx2EpXcrhKBOvojoqpjAVJwS7evC9lpT09DR2f9XkoOqpuR+3GLZChCbNDLdHqGYjgjjT1X0WdRGA5eYPOWkFxlwd0Jy1ih8FgvUg7ZgiZw=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:30.410968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-58f54236-ea5d-476a-82fe-d60e1d7b456c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:20:30.415227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-58f54236-ea5d-476a-82fe-d60e1d7b456c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for user f73a65ebe334405099f7a4f95c4a4df6 and project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:20:30.426684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR oslo.messaging._drivers.impl_rabbit [None req-58f54236-ea5d-476a-82fe-d60e1d7b456c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [916f6441-6ec4-48b0-920b-4166797bae02] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 17:20:31.433832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [None req-58f54236-ea5d-476a-82fe-d60e1d7b456c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [916f6441-6ec4-48b0-920b-4166797bae02] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34550. May 12 17:20:31.450394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-58f54236-ea5d-476a-82fe-d60e1d7b456c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.056810 May 12 17:20:31.451014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 291/575] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:20:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:32.687515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1902297273", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e057b02-0e5b-44bd-83b7-2f23a5bc0a94"}], "security_groups": [{"name": "tempest-securitygroup--1233292919"}], "key_name": "tempest-keypair-2113323179", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:32.784210 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] validate_networks() for [('8e057b02-0e5b-44bd-83b7-2f23a5bc0a94', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:20:33.137575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:20:33.137992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:20:33.138510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:20:33.138914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:20:33.139317 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:20:33.148197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:33.148634 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:33.149425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:33.149851 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:33.166278 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:20:33.170083 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Getting quotas for user f73a65ebe334405099f7a4f95c4a4df6 and project 67e7bebb3ef2474591626aa0a76d7a1d. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:20:33.180535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:20:33.182759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:20:33.228443 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3ad68f5c-8445-4795-ab94-18c8fb6b0b23 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.545669 May 12 17:20:33.229097 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 285/576] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:20:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:20:33.239512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c4eff316-b541-4781-bd5d-e2f5d39bd489 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:33.240140 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c4eff316-b541-4781-bd5d-e2f5d39bd489 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:33.293310 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c4eff316-b541-4781-bd5d-e2f5d39bd489 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:33.299758 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c4eff316-b541-4781-bd5d-e2f5d39bd489 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1238 microversion: 2.1 time: 0.064648 May 12 17:20:33.300334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 292/577] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:33 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:34.317475 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:34.318232 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:34.324870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:34.325424 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:34.326408 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:34.326977 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:34.389319 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:34.396532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d6d69c7f-e7d7-407f-9df2-ca1684d31a82 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1296 microversion: 2.1 time: 0.083819 May 12 17:20:34.397088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 286/578] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:34 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:35.413441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:35.414914 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:35.421385 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:35.422195 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:35.423330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:35.423858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:35.558906 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:35.569031 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bda3625b-975d-4163-aff2-1c631fb15acf tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.158935 May 12 17:20:35.570140 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 293/579] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:35 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:35.603505 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-364c2436-cdb6-4274-825f-bbb8fc89aa91 req-5c076e49-f794-4d0b-b240-eeb371e2a92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49694a9c-8430-4914-828c-b11634c14ec8", "tag": "f22f77f1-5b40-44e2-bbd4-24054d6825ab"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:35.613456 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-364c2436-cdb6-4274-825f-bbb8fc89aa91 req-5c076e49-f794-4d0b-b240-eeb371e2a92c service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:35.613892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-364c2436-cdb6-4274-825f-bbb8fc89aa91 req-5c076e49-f794-4d0b-b240-eeb371e2a92c service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:35.627936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-364c2436-cdb6-4274-825f-bbb8fc89aa91 req-5c076e49-f794-4d0b-b240-eeb371e2a92c service nova] Creating event network-changed:f22f77f1-5b40-44e2-bbd4-24054d6825ab for instance 49694a9c-8430-4914-828c-b11634c14ec8 on hv-cinder-84159 May 12 17:20:35.633790 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-364c2436-cdb6-4274-825f-bbb8fc89aa91 req-5c076e49-f794-4d0b-b240-eeb371e2a92c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034041 May 12 17:20:35.634393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 287/580] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:36.586122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:36.586791 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:36.593164 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:36.593613 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:36.594362 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:36.594814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:36.720917 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:36.728594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ab1f64c3-fea2-498b-aa42-a9f35c9865b4 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.146361 May 12 17:20:36.729155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 294/581] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:36 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:36.967052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:36.967625 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:36.973671 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:36.974113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:36.975475 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:36.975904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:36.999483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:20:37.074311 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7e0a0244-7a3c-4832-acea-24af63189115 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 204 len: 0 microversion: 2.1 time: 0.111592 May 12 17:20:37.075041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 288/582] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:20:36 2022] DELETE /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:20:37.083278 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:37.083892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:37.090510 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:37.090957 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:37.091722 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:37.092154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:37.228792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:37.236031 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ca38e1ad-cca3-488a-8fdc-b4a03e2d638a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1576 microversion: 2.1 time: 0.156741 May 12 17:20:37.236585 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 295/583] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:37 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:37.746016 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:37.746729 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:37.752553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:37.752995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:37.753746 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:37.754173 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:37.883026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:37.890325 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-99a45aac-a3d7-4666-bb82-6943bfed7468 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.148471 May 12 17:20:37.890931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 289/584] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:37 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:38.253845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:38.254465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:38.261446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:38.261883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:38.262734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:38.263162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:38.391560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:38.399012 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3b8de934-4cd1-4494-9ea3-69dd13d87fc1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1576 microversion: 2.1 time: 0.149026 May 12 17:20:38.399600 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 296/585] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:38 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:38.909131 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:38.909745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:38.917633 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:38.918183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:38.919058 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:38.919564 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:39.117194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:39.124602 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-91d5b658-4b74-4614-9232-3b1dc3639ea3 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.219235 May 12 17:20:39.128530 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 290/586] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:38 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:39.416676 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:39.417236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:39.423542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:39.423992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:39.424759 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:39.425194 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:39.489750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:39.497879 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d7db74a5-12f3-4fef-8fc1-a2b041c1d521 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 200 len: 1509 microversion: 2.1 time: 0.085734 May 12 17:20:39.498484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 297/587] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:39 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:39.749915 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-5bf764ac-879b-4fd7-98da-b2dbd15b1a21 req-6199f142-724e-45c8-ba97-d9c5ccc2994e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9131b16e-e337-480c-a45b-91625a94863d", "name": "network-vif-deleted", "tag": "9cb1a268-4909-4277-8a38-1bb3a04f115d"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:39.759656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-5bf764ac-879b-4fd7-98da-b2dbd15b1a21 req-6199f142-724e-45c8-ba97-d9c5ccc2994e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:39.760103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-5bf764ac-879b-4fd7-98da-b2dbd15b1a21 req-6199f142-724e-45c8-ba97-d9c5ccc2994e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:39.780264 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-5bf764ac-879b-4fd7-98da-b2dbd15b1a21 req-6199f142-724e-45c8-ba97-d9c5ccc2994e service nova] Creating event network-vif-deleted:9cb1a268-4909-4277-8a38-1bb3a04f115d for instance 9131b16e-e337-480c-a45b-91625a94863d on hv-cinder-84159 May 12 17:20:39.787684 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-5bf764ac-879b-4fd7-98da-b2dbd15b1a21 req-6199f142-724e-45c8-ba97-d9c5ccc2994e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041521 May 12 17:20:39.788293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 291/588] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:40.145213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:40.145746 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:40.151682 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:40.152357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:40.153153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:40.153665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:40.286649 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:40.294379 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-803de474-89b5-42fe-86a8-dea89e911523 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.153144 May 12 17:20:40.294979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 298/589] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:40 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:40.516784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:40.517493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:40.526205 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:40.526691 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:40.527551 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:40.528108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:40.542634 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] HTTP exception thrown: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Request method failure captured: May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d HTTP/1.1 May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUEjHvoLPOQmsvMzR3VsyfqN6V8UaCMsKRl9nWZZFoS9wt88B2RbKTIkiclyqupHCbV2H7tL_HKoKU2409-0O6Hym-J5-eNHf-Sf5b4KbjXgNjN65vpgMMjiqyL4UgQHXo1cUw33PFfPu5WTvPnVMv5I_vkO61R7EceYIr14DJsEqjA May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:20:40.544291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-TestVolumeBootPattern-580077577 May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-TestVolumeBootPattern-580077577-project May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 845032b55cfa40ad9fcd8b14782483d5 May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-TestVolumeBootPattern-580077577-project May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:20:40.545565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '9131b16e-e337-480c-a45b-91625a94863d'} May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:20:40.546371 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:20:40.547621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:40.548755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Returning 404 to user: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:20:40.548755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6b129170-b14a-40b9-873e-8ec387f8a1ce tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 404 len: 111 microversion: 2.1 time: 0.033572 May 12 17:20:40.548755 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 292/590] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:40 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:20:40.647988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-207667986", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1239243642", "security_groups": [{"name": "tempest-secgroup-smoke-206222092"}], "block_device_mapping_v2": [{"uuid": "50d7da8a-7e6e-4f37-85eb-ca2068447843", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6fb55941-2cb2-4359-bdd6-587e053b44f0"}]}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:40.757000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] validate_networks() for [('6fb55941-2cb2-4359-bdd6-587e053b44f0', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:20:41.122342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-1db6c437-8d6d-4b7e-a8ae-21ab4e4bc1b0 req-dd262c9a-73e4-4b17-afc8-42e1587c1d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49694a9c-8430-4914-828c-b11634c14ec8", "name": "network-vif-plugged", "status": "completed", "tag": "f22f77f1-5b40-44e2-bbd4-24054d6825ab"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:41.130356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-1db6c437-8d6d-4b7e-a8ae-21ab4e4bc1b0 req-dd262c9a-73e4-4b17-afc8-42e1587c1d19 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:41.131356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-1db6c437-8d6d-4b7e-a8ae-21ab4e4bc1b0 req-dd262c9a-73e4-4b17-afc8-42e1587c1d19 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:41.134345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:20:41.134973 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:20:41.135647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:20:41.136154 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:20:41.136949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:20:41.143356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-1db6c437-8d6d-4b7e-a8ae-21ab4e4bc1b0 req-dd262c9a-73e4-4b17-afc8-42e1587c1d19 service nova] Creating event network-vif-plugged:f22f77f1-5b40-44e2-bbd4-24054d6825ab for instance 49694a9c-8430-4914-828c-b11634c14ec8 on hv-cinder-84159 May 12 17:20:41.146004 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:41.147777 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:41.148606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:41.148904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-1db6c437-8d6d-4b7e-a8ae-21ab4e4bc1b0 req-dd262c9a-73e4-4b17-afc8-42e1587c1d19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030171 May 12 17:20:41.149021 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:41.149599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 293/591] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:41.168857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for project 5d002d9e79b24742b0906bc2b220d998. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:20:41.173989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for user 845032b55cfa40ad9fcd8b14782483d5 and project 5d002d9e79b24742b0906bc2b220d998. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:20:41.239245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:20:41.241327 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50d7da8a-7e6e-4f37-85eb-ca2068447843',volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:20:41.313192 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:41.314129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:41.320961 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:41.321440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:41.322210 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:41.322670 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:41.382796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e4d4c750-bd6c-431b-b508-1c200d51b904 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738950 May 12 17:20:41.383848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 299/592] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:20:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:20:41.393904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3a2ca660-0a49-4804-96cf-1eee2a0a297a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:41.394792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-3a2ca660-0a49-4804-96cf-1eee2a0a297a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:41.450993 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-3a2ca660-0a49-4804-96cf-1eee2a0a297a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:41.457720 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3a2ca660-0a49-4804-96cf-1eee2a0a297a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1094 microversion: 2.1 time: 0.067848 May 12 17:20:41.458289 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 300/593] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:41 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:41.475059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:41.482385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e01a0e5a-5856-4cc4-a91e-894005a8be3c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.173577 May 12 17:20:41.483090 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 294/594] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:41 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:42.474030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:42.475149 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:42.482056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:42.482523 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:42.483276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:42.483702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:42.499283 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:42.500003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:42.506350 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:42.506826 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:42.507861 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:42.508292 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:42.546382 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:42.554590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-905aa439-ffbe-45f5-bab4-457fa82ed00d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1192 microversion: 2.1 time: 0.084255 May 12 17:20:42.564126 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 301/595] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:42 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:42.637266 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:42.644399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bf7e91da-266c-416d-9797-e37612b8b548 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1364 microversion: 2.1 time: 0.148913 May 12 17:20:42.644958 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 295/596] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:42 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:43.572082 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:43.572775 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:43.579066 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:43.579508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:43.580268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:43.580692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:43.643947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:43.651342 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-241acbb4-4d04-4af7-8277-f0b80a630204 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1210 microversion: 2.1 time: 0.083733 May 12 17:20:43.652229 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 302/597] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:43 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:43.665571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:43.666659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:43.676240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:43.676853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:43.678237 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:43.678865 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:43.909620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:43.918388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-36854800-86b9-4844-a00d-71982b72c846 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1550 microversion: 2.1 time: 0.256926 May 12 17:20:43.918996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 296/598] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:43 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1550 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:43.935789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:43.936292 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:43.942934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:43.943691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:43.944475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:43.944916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:44.027210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-eeaac340-b6f3-4104-ac09-9e8194d3700d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095262 May 12 17:20:44.033057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 303/599] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:20:43 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:20:44.669899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:44.670547 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:44.681089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:44.681830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:44.682856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:44.683444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:44.882364 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:44.893506 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8177327c-2938-4d3b-ac84-844ef0b7dbed tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.227354 May 12 17:20:44.894837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 297/600] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:44 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:44.968960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-5963308c-b909-48bb-b7f1-db4b05e8719d req-614c8f63-0be6-4d65-b83a-873ee91f9061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a0e8b1-2d3c-4f5b-b6d9-a7039363047e", "tag": "0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:44.982662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-5963308c-b909-48bb-b7f1-db4b05e8719d req-614c8f63-0be6-4d65-b83a-873ee91f9061 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:44.983109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-5963308c-b909-48bb-b7f1-db4b05e8719d req-614c8f63-0be6-4d65-b83a-873ee91f9061 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:45.001752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-5963308c-b909-48bb-b7f1-db4b05e8719d req-614c8f63-0be6-4d65-b83a-873ee91f9061 service nova] Creating event network-changed:0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba for instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e on hv-cinder-84159 May 12 17:20:45.011140 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-5963308c-b909-48bb-b7f1-db4b05e8719d req-614c8f63-0be6-4d65-b83a-873ee91f9061 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046588 May 12 17:20:45.012318 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 304/601] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:45.069490 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-8efb68ce-683d-4c10-be05-b1670168dc72 req-c38451c3-e5d3-4b09-8327-79e9b071c2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49694a9c-8430-4914-828c-b11634c14ec8", "tag": "f22f77f1-5b40-44e2-bbd4-24054d6825ab"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:45.078025 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-8efb68ce-683d-4c10-be05-b1670168dc72 req-c38451c3-e5d3-4b09-8327-79e9b071c2bd service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:45.078612 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-8efb68ce-683d-4c10-be05-b1670168dc72 req-c38451c3-e5d3-4b09-8327-79e9b071c2bd service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:45.091740 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-8efb68ce-683d-4c10-be05-b1670168dc72 req-c38451c3-e5d3-4b09-8327-79e9b071c2bd service nova] Creating event network-changed:f22f77f1-5b40-44e2-bbd4-24054d6825ab for instance 49694a9c-8430-4914-828c-b11634c14ec8 on hv-cinder-84159 May 12 17:20:45.098550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-8efb68ce-683d-4c10-be05-b1670168dc72 req-c38451c3-e5d3-4b09-8327-79e9b071c2bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033591 May 12 17:20:45.099762 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 298/602] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:45.913459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:45.914153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:45.920361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:45.920808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:45.921564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:45.921990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:46.073492 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:46.081989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9c2b1553-f09c-4075-b3a8-898ee9e0fcab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.173555 May 12 17:20:46.092243 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 305/603] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:45 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:46.110080 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:46.110802 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:46.117358 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:46.117934 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:46.118837 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:46.119527 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:46.207057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lazy-loading 'services' on Instance uuid 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:20:46.284693 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-53c77d8e-d716-42ad-8805-28d504ebecf1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments/f21825e8-0707-4f99-8cb5-20b4da6f9a61" status: 202 len: 0 microversion: 2.1 time: 0.179582 May 12 17:20:46.285279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 299/604] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:20:46 2022] DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments/f21825e8-0707-4f99-8cb5-20b4da6f9a61 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:20:46.293608 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:46.294566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:46.301334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:46.301789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:46.302812 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:46.303253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:46.335166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ff44ab60-8500-43c5-ba80-160f34f1861d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 May 12 17:20:46.335649 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 306/605] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:20:46 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:47.100490 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:47.101195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:47.108052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.108510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.109355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.109815 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.241784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:47.249108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-836f90ee-455a-4038-b611-7a594b64d0ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.152854 May 12 17:20:47.249674 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 300/606] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:47 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:47.345893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:47.346832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:47.353067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.353512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.354268 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.354737 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.382993 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-61a62734-1099-4955-9af0-e8e2ffe49847 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040716 May 12 17:20:47.383533 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 307/607] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:20:47 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:20:47.456864 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:47.457283 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:47.463250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.463718 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.464467 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.464922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.488598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:20:47.560567 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9654f287-3b19-492a-89bb-50e1ea4fb865 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 204 len: 0 microversion: 2.1 time: 0.107352 May 12 17:20:47.561398 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 301/608] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:20:47 2022] DELETE /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:20:47.570129 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:47.573468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:47.579325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.579775 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.580535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:47.580969 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:47.703176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:47.710512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5d49b80b-4d17-481c-ba6a-65ddd9444876 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1692 microversion: 2.1 time: 0.145129 May 12 17:20:47.711009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 308/609] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:47 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1692 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:48.267454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:48.268162 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:48.275129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:48.275585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:48.276349 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:48.276782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:48.401468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:48.408651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-38fe0d80-4c69-4b8f-a8b7-3eca5212c05b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.145480 May 12 17:20:48.409218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 302/610] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:48 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:48.727558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:48.728112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:48.734414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:48.735008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:48.735769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:48.736205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:48.869164 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:48.876670 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f615f66f-7ee0-4228-a482-186f66763bf7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1692 microversion: 2.1 time: 0.153031 May 12 17:20:48.877240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 309/611] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:48 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:49.426352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:49.427029 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:49.433470 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:49.433918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:49.434715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:49.435151 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:49.563413 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:49.570571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f04ba979-946a-47c9-ac5a-290aa477214c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.148190 May 12 17:20:49.571140 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 303/612] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:49 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:49.894464 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:49.895068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:49.901347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:49.901789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:49.902566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:49.902991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.029341 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:50.036586 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-674c9386-6626-4124-bde8-4c7de85616f7 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1692 microversion: 2.1 time: 0.145981 May 12 17:20:50.037144 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 310/613] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:49 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1692 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:50.081943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:50.082513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:50.089164 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:50.089613 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.090441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:50.090875 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.112528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lazy-loading 'flavor' on Instance uuid f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:20:50.182768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7fffa195-a796-4938-8038-f486d5c2126b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "POST /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf/action" status: 202 len: 0 microversion: 2.1 time: 0.104386 May 12 17:20:50.183250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 304/614] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:20:50 2022] POST /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:20:50.191226 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:50.191828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:50.198061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:50.198541 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.199286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:50.199709 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.329887 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:50.337148 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ace63c20-76bb-42ca-9628-fa0fd3a2d23b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.149698 May 12 17:20:50.337714 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 311/615] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:50 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:50.588399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:50.589105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:50.595312 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:50.595754 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.596508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:50.596938 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:50.726220 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:50.733634 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8b77be21-b9d0-4d31-8105-363c62185ad5 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.149896 May 12 17:20:50.734194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 305/616] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:50 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:51.054007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:51.054636 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:51.061110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:51.061551 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:51.063062 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:51.063515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:51.197085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:51.204376 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e638719d-c85f-4132-8a3c-d4831b7f86e3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1692 microversion: 2.1 time: 0.155053 May 12 17:20:51.204934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 312/617] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:51 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:51.354885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:51.355493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:51.361451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:51.361899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:51.362702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:51.363136 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:51.491565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:51.498843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8093c5b5-528e-42bb-ad86-c8267efc4c13 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.147874 May 12 17:20:51.499404 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 306/618] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:51 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:51.750133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:51.750734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:51.758024 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:51.758618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:51.759509 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:51.760126 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:51.885734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:51.892928 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4ad4e081-a9e1-48ea-925f-73e496389e94 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.146595 May 12 17:20:51.893494 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 313/619] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:51 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:52.221138 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:52.221750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:52.228044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.228493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:52.229258 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.229697 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:52.451916 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:52.460085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b6f7c125-4c53-415c-8012-e3e9ceaf9c3d tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 200 len: 1692 microversion: 2.1 time: 0.242887 May 12 17:20:52.460659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 307/620] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:52 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 1692 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:52.516353 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:52.516965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:52.523752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.524200 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:52.524957 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.525389 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:52.667313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:52.676064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0ac8fc01-fa4c-4f82-ab71-b9a816544924 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.163524 May 12 17:20:52.676635 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 314/621] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:52 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:52.881264 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-b2cbb61d-3aa9-4b55-bccb-c42c06ee6221 req-a68aaeb4-a0fa-4baa-a354-acb0ecb87ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef", "name": "network-vif-deleted", "tag": "e25fed55-18b6-4d75-bd0e-374461b42fe4"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:52.890815 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-b2cbb61d-3aa9-4b55-bccb-c42c06ee6221 req-a68aaeb4-a0fa-4baa-a354-acb0ecb87ea9 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.891250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-b2cbb61d-3aa9-4b55-bccb-c42c06ee6221 req-a68aaeb4-a0fa-4baa-a354-acb0ecb87ea9 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:52.905689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-b2cbb61d-3aa9-4b55-bccb-c42c06ee6221 req-a68aaeb4-a0fa-4baa-a354-acb0ecb87ea9 service nova] Creating event network-vif-deleted:e25fed55-18b6-4d75-bd0e-374461b42fe4 for instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef on hv-cinder-84159 May 12 17:20:52.909803 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:52.909996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:52.911534 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-b2cbb61d-3aa9-4b55-bccb-c42c06ee6221 req-a68aaeb4-a0fa-4baa-a354-acb0ecb87ea9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034468 May 12 17:20:52.913188 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 308/622] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:20:52.916770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.917210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:52.918118 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:52.918723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:53.087561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:53.095854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bef90894-f45e-40f4-a4a6-c45cc51ac7ef tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.190259 May 12 17:20:53.096559 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 315/623] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:52 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:53.479322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:53.480030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:53.486363 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:53.486853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:53.487629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:53.488097 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:53.501910 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] HTTP exception thrown: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef could not be found. May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Request method failure captured: May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef HTTP/1.1 May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDbaoID1mXNalGPs8Oq4EVEG_oMbHWy9gLmpb4Pe6294BkPmlutnw9PSOScsq6PPOPIXjoUUFZgcVlQ1atTPoQdAyxxYF85WY84DoMVqpHEGfysHI9EE_bwXgIrjmZvSP7RyMEHE10MiCvSKdjSibzfxkXLIoOEGnPndR3MRdt_uuA May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 638166bec22640968de80cfeaeed437b May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:20:53.503568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/638166bec22640968de80cfeaeed437b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_638166bec22640968de80cfeaeed437b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 638166bec22640968de80cfeaeed437b May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 650969502a9f41e38066a7c269d84ab7 May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef could not be found. May 12 17:20:53.505222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef'} May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef could not be found. May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:20:53.506062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef could not be found. May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef could not be found. May 12 17:20:53.507416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:20:53.508786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Returning 404 to user: Instance 5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:20:53.508786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7ba708a4-c5f3-4dc3-a6a5-5213e151efc1 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef" status: 404 len: 111 microversion: 2.1 time: 0.031548 May 12 17:20:53.508786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 309/624] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:53 2022] GET /compute/v2.1/servers/5c29ebd7-1d9b-4dba-8a0f-7fe13bc1cdef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:20:53.514525 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8e972673-0208-40ea-9a27-f438ef9b4f64 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '.version_select at 0x7f78aec63940>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:53.534582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8e972673-0208-40ea-9a27-f438ef9b4f64 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180296754" status: 202 len: 0 microversion: 2.1 time: 0.023887 May 12 17:20:53.535197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 316/625] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 12 17:20:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180296754 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:20:53.694714 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:53.695397 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:53.701339 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:53.701905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:53.702932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:53.703580 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:53.956005 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:53.964830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ae853f7a-07f9-4906-a6ba-4f6bc5e9d0a5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.275575 May 12 17:20:53.965972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 310/626] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:53 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:54.113803 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:54.116085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:54.122354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:54.122823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:54.123709 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:54.124136 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:54.265475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:54.281445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b27034e2-38cb-4cc8-aeaa-da5a8a770326 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.169895 May 12 17:20:54.282175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 317/627] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:54 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:54.384459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:54.384943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:54.391209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:54.391796 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:54.392576 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:54.393008 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:54.417228 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-755c8942-fb40-40fe-b0f2-b2c358b8e2f7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/ips" status: 200 len: 152 microversion: 2.20 time: 0.037456 May 12 17:20:54.418245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 311/628] 10.222.0.23 () {60 vars in 1288 bytes} [Thu May 12 17:20:54 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:20:54.982412 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:54.983097 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:54.989630 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:54.990666 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:54.991478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:54.991909 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:55.008129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-26dc6ec0-5cba-4f05-9620-b4a7bfd0fc4a req-45b7f909-833c-4584-b0d8-641625fe3580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a0e8b1-2d3c-4f5b-b6d9-a7039363047e", "name": "network-vif-plugged", "status": "completed", "tag": "0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:55.018465 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-26dc6ec0-5cba-4f05-9620-b4a7bfd0fc4a req-45b7f909-833c-4584-b0d8-641625fe3580 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:55.019085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-26dc6ec0-5cba-4f05-9620-b4a7bfd0fc4a req-45b7f909-833c-4584-b0d8-641625fe3580 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:55.032029 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-26dc6ec0-5cba-4f05-9620-b4a7bfd0fc4a req-45b7f909-833c-4584-b0d8-641625fe3580 service nova] Creating event network-vif-plugged:0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba for instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e on hv-cinder-84159 May 12 17:20:55.037919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-26dc6ec0-5cba-4f05-9620-b4a7bfd0fc4a req-45b7f909-833c-4584-b0d8-641625fe3580 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034016 May 12 17:20:55.038996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 312/629] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:20:55.126950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:55.134375 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b5c7bfd0-d888-4145-9ab2-b70b5cc4a95a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.156012 May 12 17:20:55.134954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 318/630] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:54 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:55.301749 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:55.302480 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:55.308688 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:55.309143 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:55.309910 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:55.310350 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:55.443902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:55.451278 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-aed432e2-3e3c-40f2-a5ec-28038f4f85cd tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.153822 May 12 17:20:55.451852 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 313/631] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:55 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:56.151725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:56.152335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:56.159269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.159714 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.160479 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.160908 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.286366 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:20:56.287483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:56.295562 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.296235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.297007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.297436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.297939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:56.307424 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-feb7626b-3602-42c8-b94c-75c7aa252a10 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.159564 May 12 17:20:56.308000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 319/632] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:56 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:56.323973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lazy-loading 'flavor' on Instance uuid 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:20:56.468729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:56.469328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:56.475240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.475687 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.476430 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.476853 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.581062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b6676272-8729-4415-895d-363167b39cca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/action" status: 202 len: 0 microversion: 2.20 time: 0.298715 May 12 17:20:56.581852 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 314/633] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 12 17:20:56 2022] POST /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 17:20:56.586742 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:56.587329 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:56.593431 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.593884 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.594686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.595124 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.608319 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:56.616093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-14aa24e2-8a5e-4893-aa25-4d7551a641db tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1265 microversion: 2.1 time: 0.151085 May 12 17:20:56.616660 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 320/634] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:56 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:56.621348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:20:56.630357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:56.631472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:56.637604 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.638232 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.639056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.639513 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.701757 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-52cff683-1df7-45f6-b5f7-43b66ce1f776 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 204 len: 0 microversion: 2.1 time: 0.118603 May 12 17:20:56.702260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 315/635] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:20:56 2022] DELETE /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:20:56.710376 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:56.711171 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:56.716997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.717425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.718194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:56.718652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:56.773924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:56.781593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:56.783160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:56.784289 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a6353847-5403-4016-92c6-dab002b1e18d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.157794 May 12 17:20:56.784851 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 321/636] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:56 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:56.845739 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:56.854305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-18d1e3e5-ddcc-42e6-9ec7-6a2b3787e7dd tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1508 microversion: 2.1 time: 0.147919 May 12 17:20:56.855219 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 316/637] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:56 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:57.324897 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:57.325533 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:57.332074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.332522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.333309 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.333739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.459030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:57.466313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-be1847a0-1fca-448e-bf76-1c73ff005c77 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.145324 May 12 17:20:57.467014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 322/638] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:57 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:57.633425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:57.633954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:57.640280 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.640741 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.641484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.641915 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.766591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:57.774279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9c072f60-e4eb-4f61-86b8-c4fc2826c4c4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1452 microversion: 2.1 time: 0.145049 May 12 17:20:57.774860 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 317/639] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:57 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:57.790730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:57.791330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:57.797172 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.797812 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.798596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.799023 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.802089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:57.802709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:57.808406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.808851 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.809604 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.810033 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.931704 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:57.938966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c89c2d9e-ad33-45b5-8890-4fd9448edbd6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1452 microversion: 2.1 time: 0.152754 May 12 17:20:57.939535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 323/640] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:57 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:57.940013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:57.943920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:57.944715 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:57.947992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:57.949565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:57.950534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.950741 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-24a9d7f5-7416-42e8-a68e-2bc66b66838f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.152356 May 12 17:20:57.950989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:57.951294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 318/641] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:57 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:20:57.952127 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:57.952563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:58.081491 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:58.089508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-01d47835-7883-4d7c-b227-7f0b18795e26 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1508 microversion: 2.1 time: 0.149029 May 12 17:20:58.090694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 324/642] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:57 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:58.483881 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:58.484400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:58.490291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:58.490778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:58.492416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:58.492855 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:58.709932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:58.718342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-87844e2f-0e37-4f7f-a696-6368dda0a5f1 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.238421 May 12 17:20:58.718933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 319/643] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:58 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:20:58.969461 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:58.970061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:58.977217 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:58.977665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:58.978458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:58.978883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:59.106942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:59.107877 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:59.114100 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:59.114588 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:59.115374 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:59.115888 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:59.346186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:59.355223 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:59.357041 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:59.358255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5efe5157-1445-4254-85a2-06b7cd3ce3e7 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.392871 May 12 17:20:59.358910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 325/644] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:20:58 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:20:59.563556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:59.573135 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b128f9d7-3920-4868-91ee-b96259810190 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1508 microversion: 2.1 time: 0.469639 May 12 17:20:59.573873 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 320/645] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:59 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:20:59.735400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:20:59.736127 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:20:59.742857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:59.743308 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:59.744071 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:20:59.744530 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:20:59.930412 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:20:59.937804 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c82fbaec-1d91-4b69-a311-5751261bc42f tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.206275 May 12 17:20:59.938476 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 326/646] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:20:59 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:00.278787 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-cd10462e-51d5-4876-b089-4fc2a17522d3 req-fb92f5a5-3777-4195-b1d5-46690d893e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a0e8b1-2d3c-4f5b-b6d9-a7039363047e", "tag": "0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:00.287476 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-cd10462e-51d5-4876-b089-4fc2a17522d3 req-fb92f5a5-3777-4195-b1d5-46690d893e75 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.288162 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-cd10462e-51d5-4876-b089-4fc2a17522d3 req-fb92f5a5-3777-4195-b1d5-46690d893e75 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:00.300269 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-cd10462e-51d5-4876-b089-4fc2a17522d3 req-fb92f5a5-3777-4195-b1d5-46690d893e75 service nova] Creating event network-changed:0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba for instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e on hv-cinder-84159 May 12 17:21:00.306026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-cd10462e-51d5-4876-b089-4fc2a17522d3 req-fb92f5a5-3777-4195-b1d5-46690d893e75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030838 May 12 17:21:00.306967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 321/647] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:00.376635 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:00.377241 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:00.385673 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.386373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:00.387176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.387785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:00.590840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:00.591956 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:00.599532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.600310 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:00.601868 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.602996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:00.626287 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:00.639220 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:00.640770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:00.641954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7b30ef33-83c8-4637-91b3-8be7ee42996f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.269253 May 12 17:21:00.642539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 327/648] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:00 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:00.893644 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:00.905463 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e9302d9f-7843-46c8-b940-017ddfad63e6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1508 microversion: 2.1 time: 0.318483 May 12 17:21:00.916739 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 322/649] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:00 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:21:00.954373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:00.955471 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:00.971886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.972344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:00.973305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:00.973880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:01.194356 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:01.204501 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7aaa7dda-e7ff-407c-b21a-2c73bdb7fb0c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.254101 May 12 17:21:01.205077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 328/650] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:00 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:01.659853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:01.660454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:01.666838 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:01.667287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:01.668049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:01.668481 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:01.792526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:01.800146 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:01.801658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:01.802836 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bf29bc96-7ceb-47b9-95cf-1088b0056be4 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.146960 May 12 17:21:01.803404 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 323/651] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:01 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:01.924186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:01.924974 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:01.931866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:01.932311 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:01.933303 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:01.933737 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:01.963971 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:01.964404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:01.964844 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lazy-loading 'fault' on Instance uuid 68fea2bf-d6a6-4a97-be8f-bd754b36e60c {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:21:02.008432 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:02.014992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e7fd5df7-512a-48c7-9d15-476f6613aa86 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 200 len: 1312 microversion: 2.1 time: 0.094945 May 12 17:21:02.015550 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 329/652] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:01 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:02.221168 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:02.221696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:02.228007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:02.228452 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:02.229232 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:02.229645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:02.327137 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-b733513c-4f87-4e9f-b58f-9f847bd3dacc req-4015855e-b439-435f-93fc-971499bb9ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fea2bf-d6a6-4a97-be8f-bd754b36e60c", "name": "network-vif-deleted", "tag": "4b14ecbe-91e8-4995-96ec-24bef4c83422"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:02.336072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b733513c-4f87-4e9f-b58f-9f847bd3dacc req-4015855e-b439-435f-93fc-971499bb9ca6 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:02.336516 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b733513c-4f87-4e9f-b58f-9f847bd3dacc req-4015855e-b439-435f-93fc-971499bb9ca6 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:02.348713 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-b733513c-4f87-4e9f-b58f-9f847bd3dacc req-4015855e-b439-435f-93fc-971499bb9ca6 service nova] Creating event network-vif-deleted:4b14ecbe-91e8-4995-96ec-24bef4c83422 for instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c on hv-cinder-84159 May 12 17:21:02.354674 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-b733513c-4f87-4e9f-b58f-9f847bd3dacc req-4015855e-b439-435f-93fc-971499bb9ca6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 May 12 17:21:02.355372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 330/653] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:21:02.370806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:02.378230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6cfd30cc-8b99-4d3d-b931-cc2f5c79e5ec tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.160994 May 12 17:21:02.378920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 324/654] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:02 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:02.925431 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:02.926126 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:02.932672 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:02.933115 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:02.933875 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:02.934308 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.030821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:03.031453 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 68fea2bf-d6a6-4a97-be8f-bd754b36e60c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:03.037667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.038167 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.039509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.039942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.053083 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] HTTP exception thrown: Instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c could not be found. May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Request method failure captured: May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c HTTP/1.1 May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDbaoID1mXNalGPs8Oq4EVEG_oMbHWy9gLmpb4Pe6294BkPmlutnw9PSOScsq6PPOPIXjoUUFZgcVlQ1atTPoQdAyxxYF85WY84DoMVqpHEGfysHI9EE_bwXgIrjmZvSP7RyMEHE10MiCvSKdjSibzfxkXLIoOEGnPndR3MRdt_uuA May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 638166bec22640968de80cfeaeed437b May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:21:03.054736 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/638166bec22640968de80cfeaeed437b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_638166bec22640968de80cfeaeed437b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 638166bec22640968de80cfeaeed437b May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 650969502a9f41e38066a7c269d84ab7 May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c could not be found. May 12 17:21:03.056361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '68fea2bf-d6a6-4a97-be8f-bd754b36e60c'} May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c could not be found. May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:21:03.057142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c could not be found. May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c could not be found. May 12 17:21:03.058379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:03.059832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Returning 404 to user: Instance 68fea2bf-d6a6-4a97-be8f-bd754b36e60c could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:21:03.059832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-166bcc2a-4c5d-4de4-b87f-81a0f78328f3 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c" status: 404 len: 111 microversion: 2.1 time: 0.029117 May 12 17:21:03.059832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 325/655] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:03 2022] GET /compute/v2.1/servers/68fea2bf-d6a6-4a97-be8f-bd754b36e60c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:21:03.064256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:03.064746 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:03.070227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:03.070739 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.071181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.071944 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.072375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.077894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:03.079344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:03.080483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-039f0a94-1aa9-4fdb-a686-7a062d30cc68 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.263104 May 12 17:21:03.081045 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 331/656] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:02 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:03.097199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:21:03.170178 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5e908ef4-30b5-457d-87c7-70c3e47f674f tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 204 len: 0 microversion: 2.1 time: 0.109209 May 12 17:21:03.170773 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 326/657] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:21:03 2022] DELETE /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:21:03.178530 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:03.179634 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:03.185304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.185745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.186527 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.186956 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.310573 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:03.317749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ba20edf6-ed90-40c9-9cb9-5b5764f395a6 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.142999 May 12 17:21:03.318319 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 332/658] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:03 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:03.395803 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:03.396415 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:03.402268 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.402751 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.403506 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:03.403945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:03.531237 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:03.539015 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a59c9295-c291-44e0-b5d7-548aca8a5aab tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.147033 May 12 17:21:03.539592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 327/659] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:03 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:04.098961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:04.099558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:04.106553 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:04.106999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:04.107753 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:04.108210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:04.237666 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:04.245312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:04.246834 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:04.247968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6755187b-8b6d-40cf-9e65-fd6dfd081777 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.152976 May 12 17:21:04.248518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 333/660] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:04 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:04.336382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:04.336993 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:04.343779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:04.344234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:04.344999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:04.345436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:04.471497 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:04.479642 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6226baf7-facf-4724-8f6b-71d629cc6e84 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.147857 May 12 17:21:04.480222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 328/661] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:04 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:04.556198 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:04.556796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:04.562589 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:04.563029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:04.563787 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:04.564197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:04.688121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:04.695981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-46e878c7-d8fb-4125-9805-4abc88b7f410 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.144169 May 12 17:21:04.696538 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 334/662] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:04 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:05.266841 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:05.267473 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:05.274014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:05.274486 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:05.275245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:05.275674 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:05.399070 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:05.406820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:05.408305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:05.409439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0b304c16-3435-462b-ad45-01958791ca03 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.146558 May 12 17:21:05.409994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 329/663] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:05 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:05.496296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:05.496918 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:05.502866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:05.503304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:05.504051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:05.504478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:05.632397 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:05.639811 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4fe23802-2849-41f3-a30a-b5ab42fb24c0 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.147322 May 12 17:21:05.640378 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 335/664] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:05 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:05.712964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:05.714155 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:05.721128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:05.721622 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:05.722386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:05.722966 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:05.848351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:05.855566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-38353514-8249-4534-b773-beb586c673e4 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.146561 May 12 17:21:05.856134 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 330/665] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:05 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:06.428205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:06.428827 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:06.434719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:06.435169 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:06.435920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:06.436347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:06.561219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:06.568903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:06.570927 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:06.572073 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-597987c6-7bd7-436b-9548-401ba66ec695 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.147927 May 12 17:21:06.572627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 336/666] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:06 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:06.656703 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:06.657245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:06.663614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:06.664086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:06.664845 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:06.665279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:06.791640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:06.798827 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-02b347d9-8666-480e-84ba-14cb97e2bed9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.145973 May 12 17:21:06.799393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 331/667] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:06 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:06.872728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:06.873732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:06.879437 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:06.879892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:06.880657 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:06.881089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:07.006246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:07.016345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-91d679f3-c5f5-4636-9bc5-1e5f253a67a0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.147411 May 12 17:21:07.016919 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 337/668] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:06 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:07.589059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:07.589640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:07.595595 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:07.596037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:07.596780 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:07.597203 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:07.718678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:07.726245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:07.727747 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:07.728874 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-de3cc543-d402-4d97-ba09-a10b4bad9ed3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.143740 May 12 17:21:07.729424 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 332/669] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:07 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:07.816042 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:07.816587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:07.823481 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:07.823931 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:07.824690 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:07.825124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:07.955546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:07.962732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4f68bb02-5f80-4293-9ef2-72696d105dd9 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1522 microversion: 2.1 time: 0.150538 May 12 17:21:07.963303 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 338/670] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:07 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:21:08.034608 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:08.035209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:08.042059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.042544 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:08.043300 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.043733 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:08.177382 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:08.185531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-911b3b38-73b0-4c5e-9776-aefeb60da22b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.154758 May 12 17:21:08.186176 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 333/671] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:08 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:08.626037 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-e3ad9671-b035-46a4-88fc-da522cc15010 req-e547d1a9-4bee-4cf8-901d-da8e029534e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674ec2ad-d5d1-46d6-b683-b5c2bd561c9a", "name": "network-vif-deleted", "tag": "d57d4a88-7f65-442d-9424-fce30450293a"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:08.635029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-e3ad9671-b035-46a4-88fc-da522cc15010 req-e547d1a9-4bee-4cf8-901d-da8e029534e2 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.635499 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-e3ad9671-b035-46a4-88fc-da522cc15010 req-e547d1a9-4bee-4cf8-901d-da8e029534e2 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:08.645880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-e3ad9671-b035-46a4-88fc-da522cc15010 req-e547d1a9-4bee-4cf8-901d-da8e029534e2 service nova] Creating event network-vif-deleted:d57d4a88-7f65-442d-9424-fce30450293a for instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a on hv-cinder-84159 May 12 17:21:08.650961 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-e3ad9671-b035-46a4-88fc-da522cc15010 req-e547d1a9-4bee-4cf8-901d-da8e029534e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028526 May 12 17:21:08.651541 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 339/672] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:08.747303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:08.747903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:08.754184 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.754672 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:08.755454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.755883 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:08.892937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:08.903999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:08.906261 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:08.908269 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-169b806d-9fc3-43dc-86a2-dc4c8084218b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.164071 May 12 17:21:08.908905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 334/673] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:08 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:08.980686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:08.981535 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:08.988087 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.988774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:08.990156 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:08.991724 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.021459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-9814be3c-d1b3-4e4b-b625-a211004c679b req-90d56e98-6236-437a-bc24-52eb47c0fb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "name": "network-vif-unplugged", "status": "completed", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:09.025630 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.026089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.026563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lazy-loading 'fault' on Instance uuid 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:21:09.032008 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9814be3c-d1b3-4e4b-b625-a211004c679b req-90d56e98-6236-437a-bc24-52eb47c0fb17 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.032637 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9814be3c-d1b3-4e4b-b625-a211004c679b req-90d56e98-6236-437a-bc24-52eb47c0fb17 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.045423 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.compute.server_external_events [req-9814be3c-d1b3-4e4b-b625-a211004c679b req-90d56e98-6236-437a-bc24-52eb47c0fb17 service nova] Unable to find a host for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf. Dropping event network-vif-unplugged {{(pid=117074) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 17:21:09.046596 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-9814be3c-d1b3-4e4b-b625-a211004c679b req-90d56e98-6236-437a-bc24-52eb47c0fb17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029235 May 12 17:21:09.047685 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 335/674] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 12 17:21:09.073963 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '650969502a9f41e38066a7c269d84ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638166bec22640968de80cfeaeed437b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:09.081284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e674dbf7-071b-4310-8a9d-c6dde6010a88 tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 200 len: 1312 microversion: 2.1 time: 0.105239 May 12 17:21:09.081869 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 340/675] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:08 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:09.203367 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:09.203876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:09.209752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.210194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.210975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.211411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.336523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:09.344053 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0ffc193f-e7b8-4f88-b9a9-470ce30be71c tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1509 microversion: 2.1 time: 0.144575 May 12 17:21:09.344616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 336/676] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:09 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:09.360334 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:09.360892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:09.367562 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.368006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.368800 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.369260 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.464098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f0722de5-06d7-42c6-8c94-14af16004853 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "POST /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf/action" status: 202 len: 0 microversion: 2.1 time: 0.107660 May 12 17:21:09.464614 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 341/677] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:21:09 2022] POST /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:21:09.472838 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:09.473659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:09.479842 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.480291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.481057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.481488 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.612075 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:09.619939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-09d54db8-131e-418b-9023-80ffde8c1b37 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1517 microversion: 2.1 time: 0.150962 May 12 17:21:09.620504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 337/678] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:09 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:21:09.925975 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:09.926621 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:09.932583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.933028 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:09.933793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:09.934232 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:10.073488 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:10.081348 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:10.082973 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:10.084114 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b1551ddc-ebab-42d4-ab90-8ebb6c0a4798 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.162048 May 12 17:21:10.084659 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 342/679] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:09 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:10.098013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:10.098719 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] [instance: 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:10.105662 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:10.106108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:10.106898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:10.107416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:10.120489 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] HTTP exception thrown: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a could not be found. May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Request method failure captured: May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a HTTP/1.1 May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDbaoID1mXNalGPs8Oq4EVEG_oMbHWy9gLmpb4Pe6294BkPmlutnw9PSOScsq6PPOPIXjoUUFZgcVlQ1atTPoQdAyxxYF85WY84DoMVqpHEGfysHI9EE_bwXgIrjmZvSP7RyMEHE10MiCvSKdjSibzfxkXLIoOEGnPndR3MRdt_uuA May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 638166bec22640968de80cfeaeed437b May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:21:10.122088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/638166bec22640968de80cfeaeed437b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_638166bec22640968de80cfeaeed437b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/638166bec22640968de80cfeaeed437b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 638166bec22640968de80cfeaeed437b May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263118453 May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 650969502a9f41e38066a7c269d84ab7 May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263118453-project May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a could not be found. May 12 17:21:10.123689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '674ec2ad-d5d1-46d6-b683-b5c2bd561c9a'} May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a could not be found. May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:21:10.124521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a could not be found. May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a could not be found. May 12 17:21:10.125962 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:21:10.127299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] Returning 404 to user: Instance 674ec2ad-d5d1-46d6-b683-b5c2bd561c9a could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:21:10.127299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-399785b6-e176-444d-93f2-2f67f38bc9fa tempest-ServerRescueNegativeTestJSON-1263118453 tempest-ServerRescueNegativeTestJSON-1263118453-project] 10.222.0.23 "GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a" status: 404 len: 111 microversion: 2.1 time: 0.029293 May 12 17:21:10.127299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 338/680] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:10 2022] GET /compute/v2.1/servers/674ec2ad-d5d1-46d6-b683-b5c2bd561c9a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:21:10.639506 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:10.640400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:10.648577 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:10.649098 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:10.649963 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:10.650557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:10.800175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:10.809061 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8bee859b-4972-4549-8aa3-4bd3fa7c4406 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1519 microversion: 2.1 time: 0.174695 May 12 17:21:10.809702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 343/681] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:10 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:21:11.105576 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:11.106342 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:11.113678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:11.114214 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:11.115081 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:11.115582 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:11.318769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:11.329660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:11.332992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:11.335089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-49df26f2-70b3-4472-ba55-5adcb94dfe5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1744 microversion: 2.20 time: 0.235977 May 12 17:21:11.336168 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 339/682] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:11 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:11.827614 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:11.828335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:11.836259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:11.836790 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:11.837639 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:11.838137 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:11.986932 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:11.994796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-509736fa-d156-4cad-b72c-c6045856beb0 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.171133 May 12 17:21:11.995556 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 344/683] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:11 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:12.354513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:12.355277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:12.362092 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:12.362731 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:12.363798 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:12.364302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:12.581199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:12.589980 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:12.591537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:12.592807 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-318800c9-bb0b-4965-8a4a-d74594af7ec8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1744 microversion: 2.20 time: 0.242978 May 12 17:21:12.593368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 340/684] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:12 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:13.015889 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:13.017175 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:13.025778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:13.026699 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:13.027727 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:13.028566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:13.138175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-0438d115-175f-4469-b2ca-0cc180f46eca req-24efa381-0d07-480d-9917-f9cb7bd622d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "name": "network-vif-plugged", "status": "completed", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:13.176207 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-0438d115-175f-4469-b2ca-0cc180f46eca req-24efa381-0d07-480d-9917-f9cb7bd622d0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:13.176650 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-0438d115-175f-4469-b2ca-0cc180f46eca req-24efa381-0d07-480d-9917-f9cb7bd622d0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:13.211578 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:13.211779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-0438d115-175f-4469-b2ca-0cc180f46eca req-24efa381-0d07-480d-9917-f9cb7bd622d0 service nova] Creating event network-vif-plugged:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:21:13.218801 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-0438d115-175f-4469-b2ca-0cc180f46eca req-24efa381-0d07-480d-9917-f9cb7bd622d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088636 May 12 17:21:13.219651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 341/685] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:13.221945 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-02e77523-e76c-49df-ad2b-dbfcc54ef2c3 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.212118 May 12 17:21:13.222451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 345/686] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:13 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:13.625436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:13.627317 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:13.644447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:13.649900 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:13.655171 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:13.658885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:13.821487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:13.830271 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:13.832339 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:13.833876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7a80d07d-800a-49b5-a599-49442ddad594 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.225069 May 12 17:21:13.835602 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 342/687] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:13 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:14.241213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:14.241940 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:14.249838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:14.250297 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:14.251216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:14.251828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:14.443609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:14.452999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5928b11f-8d8b-4091-aab7-200cff81c4c5 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.216281 May 12 17:21:14.455078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 346/688] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:14 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:14.854861 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:14.855606 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:14.863073 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:14.863832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:14.864848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:14.865507 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:15.109215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:15.122769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:15.124285 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:15.125717 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a2a4f899-0e1d-42a8-a528-c45d064134c8 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.276399 May 12 17:21:15.126820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 343/689] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:14 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:15.470543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:15.471340 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:15.478317 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:15.479040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:15.479968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:15.480606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:15.642448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:15.651910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a4dfc034-1acf-4ae8-a9cd-09c336418c4b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.185090 May 12 17:21:15.652729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 347/690] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:15 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:16.150761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:16.151385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:16.158106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:16.158441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:16.159420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:16.159908 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:16.379589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:16.390079 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:16.391611 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:16.392964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-41f50efa-ab46-428d-9f40-9a2226a5618f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.252649 May 12 17:21:16.394112 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 344/691] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:16 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:16.670094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:16.670999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:16.680917 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:16.685937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:16.686810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:16.687249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:16.829531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:16.838663 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9bc282a0-a50d-4df9-8af9-a750bbb5e2de tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.173356 May 12 17:21:16.839496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 348/692] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:16 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:17.412004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:17.413393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:17.420967 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:17.421428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:17.422208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:17.422673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:17.558387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:17.566671 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:17.568142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:17.569509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0b598e97-8081-4f1c-9bdd-7c8f1af29acb tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.161803 May 12 17:21:17.570236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 345/693] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:17 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:17.855300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:17.855902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:17.863073 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:17.871784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:17.872897 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:17.873605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:18.111670 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:18.121644 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6afae5aa-d380-4b8c-8b61-471b7b4a5e8d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.270255 May 12 17:21:18.123075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 349/694] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:17 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:18.588054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:18.589219 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:18.596182 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:18.597089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:18.597873 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:18.598496 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:18.736064 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:18.747464 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:18.749129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:18.750508 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-47b62f88-fa9c-43e4-af07-ee763e38116a tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.166614 May 12 17:21:18.751170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 346/695] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:18 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:19.141206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:19.143407 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:19.152988 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:19.153703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:19.154506 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:19.155110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:19.349136 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:19.361393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-28b755b9-65a2-4b6a-af0a-dd10375b8a1d tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.225500 May 12 17:21:19.361977 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 350/696] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:19 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:19.769651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:19.770281 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:19.779599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:19.779989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:19.780998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:19.781578 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:19.978240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:19.988941 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:19.990726 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:19.992660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-64496444-f154-43d7-a2ab-2da3cfdc7d10 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.227443 May 12 17:21:19.993401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 347/697] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:19 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:20.384195 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:20.385648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:20.399870 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:20.400468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:20.401355 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:20.401921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:20.551458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:20.559913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c163dd9f-601c-41ea-952a-055645f5acc2 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.184084 May 12 17:21:20.570216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 351/698] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:20 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:21.010244 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:21.011575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:21.017968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:21.018565 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:21.019550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:21.020217 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:21.163905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:21.172471 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:21.174056 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:21.175304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5e7214b7-4f3d-4a9b-89ce-f14a65df6a5c tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.169223 May 12 17:21:21.186318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 348/699] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:21 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:21.577747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:21.578689 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:21.585970 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:21.586534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:21.587373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:21.587871 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:21.725546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:21.733586 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4a07f6cc-af3a-48dd-aa85-12dfc76c4849 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.159631 May 12 17:21:21.734255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 352/700] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:21 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:22.193353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:22.193939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:22.200944 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:22.201439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:22.202234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:22.202774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:22.348526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:22.357747 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:22.359309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:22.360543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8ed55b1e-6e48-40ce-9b32-fd3aefa4c5c5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.171229 May 12 17:21:22.361128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 349/701] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:22 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:22.752564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:22.753872 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:22.761174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:22.761561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:22.762338 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:22.762831 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:22.917229 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:22.926414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7dd796de-616f-4455-9014-dc013719df68 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.178609 May 12 17:21:22.927810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 353/702] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:22 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:23.121154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-455d1780-2cb1-40b5-9bd0-fc3eaa46e507 req-c618b664-ba2e-47a1-9ec2-a91003344206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "name": "network-vif-plugged", "status": "completed", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:23.129779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-455d1780-2cb1-40b5-9bd0-fc3eaa46e507 req-c618b664-ba2e-47a1-9ec2-a91003344206 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:23.130924 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-455d1780-2cb1-40b5-9bd0-fc3eaa46e507 req-c618b664-ba2e-47a1-9ec2-a91003344206 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:23.153237 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-455d1780-2cb1-40b5-9bd0-fc3eaa46e507 req-c618b664-ba2e-47a1-9ec2-a91003344206 service nova] Creating event network-vif-plugged:b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3 for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf on hv-cinder-84159 May 12 17:21:23.159549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-455d1780-2cb1-40b5-9bd0-fc3eaa46e507 req-c618b664-ba2e-47a1-9ec2-a91003344206 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041624 May 12 17:21:23.160358 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 350/703] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:23.379659 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:23.380183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:23.387238 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:23.387688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:23.388560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:23.388997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:23.530862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:23.539446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:23.540954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:23.542112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-faef5c01-c6b8-4855-a376-74f22189e856 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1739 microversion: 2.20 time: 0.166455 May 12 17:21:23.542715 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 354/704] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:23 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:23.944143 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:23.944851 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:23.951197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:23.951718 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:23.952563 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:23.953096 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:24.089618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:24.098135 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-67bfc3e5-9247-4415-aea0-274d415cf97a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1575 microversion: 2.1 time: 0.158714 May 12 17:21:24.098869 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 351/705] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:23 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:24.560439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:24.561073 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:24.567344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:24.567795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:24.568543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:24.569518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:24.754236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:24.762330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:24.763870 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:24.765009 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-611a414c-3c7f-4612-a619-047a194466d0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1721 microversion: 2.20 time: 0.208479 May 12 17:21:24.766229 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 355/706] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:24 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:25.115557 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:25.116103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:25.122395 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:25.122878 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:25.123645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:25.124078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:25.257756 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:25.265317 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e167e961-a24f-41e1-84d6-b21799f833cc tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1562 microversion: 2.1 time: 0.153717 May 12 17:21:25.265963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 352/707] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:21:25 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:21:25.785735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:25.786357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:25.794014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:25.794503 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:25.795265 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:25.795695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:25.932116 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:25.939879 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:25.941408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:25.942567 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-cd2007a0-f7fe-40fe-adc8-0de9cf680b5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1721 microversion: 2.20 time: 0.161772 May 12 17:21:25.943129 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 356/708] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:25 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:26.961181 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:26.961792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:26.968148 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:26.968601 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:26.969388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:26.969818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:27.069656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-5c3db930-6d9c-4805-80c2-74987f720ecb req-1fe37b4b-94a9-4def-900a-d599f63529e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "name": "network-vif-unplugged", "status": "completed", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:27.078950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-5c3db930-6d9c-4805-80c2-74987f720ecb req-1fe37b4b-94a9-4def-900a-d599f63529e2 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:27.079510 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-5c3db930-6d9c-4805-80c2-74987f720ecb req-1fe37b4b-94a9-4def-900a-d599f63529e2 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:27.092652 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-5c3db930-6d9c-4805-80c2-74987f720ecb req-1fe37b4b-94a9-4def-900a-d599f63529e2 service nova] Creating event network-vif-unplugged:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:21:27.097967 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-5c3db930-6d9c-4805-80c2-74987f720ecb req-1fe37b4b-94a9-4def-900a-d599f63529e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032759 May 12 17:21:27.098866 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 357/709] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:27.103103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:27.111459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:27.112946 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:27.114078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3fc8ee89-2f79-4009-b128-45a2dda534e3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1721 microversion: 2.20 time: 0.156851 May 12 17:21:27.114671 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 353/710] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:26 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:28.133276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:28.134000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:28.140520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.140967 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.141724 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.142161 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.276068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:28.284623 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:28.286274 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:28.287528 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-43a1ce16-ac70-4262-b376-e31b839cf915 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1664 microversion: 2.20 time: 0.159242 May 12 17:21:28.288120 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 358/711] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:28 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:28.305159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde3f196-7549-4f38-bcb2-efec5a023a9e"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:28.306268 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:28.312827 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.313216 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.314022 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.314554 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.587849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7b32960e-b32c-48ff-a0de-195c779a81c2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286702 May 12 17:21:28.588468 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 354/712] 10.222.0.23 () {62 vars in 1363 bytes} [Thu May 12 17:21:28 2022] POST /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:21:28.696057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:28.696542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:28.702369 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.702846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.703590 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.704017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.915902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7c0358ae-191a-4439-91e2-8328600ffe4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-volume_attachments/cde3f196-7549-4f38-bcb2-efec5a023a9e" status: 202 len: 0 microversion: 2.20 time: 0.224215 May 12 17:21:28.916508 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 359/713] 10.222.0.23 () {60 vars in 1456 bytes} [Thu May 12 17:21:28 2022] DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-volume_attachments/cde3f196-7549-4f38-bcb2-efec5a023a9e => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:21:28.970500 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:28.971062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:28.977965 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.978433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:28.979197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:28.979668 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:29.052570 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c5e49d1c-bcd4-49e5-875a-ee7c0cf2ebe1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "POST /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/action" status: 202 len: 0 microversion: 2.20 time: 0.086100 May 12 17:21:29.053720 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 355/714] 10.222.0.23 () {62 vars in 1318 bytes} [Thu May 12 17:21:28 2022] POST /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:21:29.061836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:29.062462 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:29.068241 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:29.068696 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:29.069465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:29.069902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:29.227589 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:29.236248 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:29.237903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:29.239256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-94482dca-f22e-4081-a383-4adf74a5d79e tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1672 microversion: 2.20 time: 0.181260 May 12 17:21:29.242534 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 360/715] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:29 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:30.260768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:30.261405 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:30.267684 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:30.268130 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:30.268893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:30.269326 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:30.401141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:30.409927 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:30.411716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:30.412566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-99b74167-ed02-419b-baa3-f85df8d6aee0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.158396 May 12 17:21:30.413120 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 356/716] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:30 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:31.432032 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:31.432609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:31.439611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:31.440051 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:31.440814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:31.441240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:31.579481 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:31.587880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:31.589616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:31.590985 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1e2f3412-b8f0-49ef-bcca-bd979b190f16 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.163492 May 12 17:21:31.591950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 361/717] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:31 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:32.052220 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:32.052728 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:32.059709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:32.060355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:32.061301 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:32.061738 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:32.120445 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4a577335-5a24-4350-811e-3050cfdec31d tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/ips" status: 200 len: 146 microversion: 2.1 time: 0.268340 May 12 17:21:32.121258 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 357/718] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:21:31 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/ips => generated 146 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:32.609451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:32.609990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:32.616348 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:32.616830 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:32.617587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:32.618012 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:32.754543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:32.763725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:32.765224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:32.766401 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-cc08ed27-b56b-4b1b-bd9c-69dd615597ca tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.161077 May 12 17:21:32.766997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 362/719] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:32 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:33.503023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdf27d07-2493-44e6-806d-6742e680b7b0"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:33.504705 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:33.512096 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:33.512549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:33.513331 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:33.513763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:33.785204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:33.785921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:33.792617 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:33.793150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:33.794006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:33.794546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:33.932731 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:33.940395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:33.941877 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:33.943168 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-893fa4e0-281c-44e7-9512-58658e999e81 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.161910 May 12 17:21:33.943743 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 363/720] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:33 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:34.961185 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:34.961981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:34.967915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:34.968383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:34.969147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:34.969587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:35.104542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:35.117246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:35.118801 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:35.120430 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6f8b2248-fbf0-4b79-9af5-4f6861438f30 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.162989 May 12 17:21:35.121019 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 364/721] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:34 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:36.139580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:36.140248 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:36.146108 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:36.146583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:36.147348 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:36.147778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:36.299260 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:36.307792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:36.309350 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:36.310583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c2558604-84d1-4dd4-90b7-0c549650e551 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.174914 May 12 17:21:36.311159 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 365/722] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:36 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:37.329089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:37.329788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:37.336652 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:37.337232 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:37.338038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:37.338493 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:37.480607 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:37.489040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:37.491265 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:37.492452 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-db9b0144-24ba-476c-a15b-3cdd03ed0021 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.167314 May 12 17:21:37.493002 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 366/723] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:37 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:38.510502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:38.511215 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:38.518578 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:38.519350 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:38.520373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:38.521074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:38.667377 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:38.675648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:38.677122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:38.678281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c1198371-a9cc-4b1e-b80f-ed161d46f6be tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.172189 May 12 17:21:38.678936 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 367/724] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:38 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:39.697471 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:39.698158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:39.706350 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:39.707196 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:39.707965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:39.708403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:39.842301 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:39.850153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:39.851745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:39.852959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d1e9699c-4483-45ad-a2a0-e5e63bea435d tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.159992 May 12 17:21:39.853531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 368/725] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:39 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:40.870685 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:40.871313 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:40.877595 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:40.878038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:40.878814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:40.879248 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:41.007807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:41.015411 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:41.016895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:41.018019 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9c2fdd01-8a1a-4476-b19c-cdb06b0522b2 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.151345 May 12 17:21:41.018669 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 369/726] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:40 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:42.035683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:42.036338 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:42.042741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:42.043190 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:42.043942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:42.044375 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:42.172570 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:42.180745 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:42.182238 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:42.183405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f7a7fa9b-0ad2-425f-9c11-78f56e5bda05 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.151628 May 12 17:21:42.183965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 370/727] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:42 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:43.201643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:43.202303 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:43.208458 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:43.208904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:43.209657 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:43.210752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:43.341236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:43.348788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:43.350255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:43.351429 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9bf794e5-1b32-4371-b786-6eef8ab748f3 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.153781 May 12 17:21:43.351981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 371/728] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:43 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:44.369062 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:44.369734 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:44.376016 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:44.376456 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:44.377210 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:44.377639 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:44.502064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:44.510064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:44.511586 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:44.512747 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1d8a0932-51d1-49ee-998c-f025466c2c5b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.147580 May 12 17:21:44.513302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 372/729] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:44 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:21:44.958820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-cbdc2e8b-9967-46a2-8fab-b22d851a3d94 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.459790 May 12 17:21:44.959578 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 358/730] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:21:33 2022] POST /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments => generated 194 bytes in 11461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:45.531758 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:45.532394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:45.539177 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:45.539617 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:45.540363 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:45.540793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:45.677473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:45.685746 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:45.687274 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:45.688397 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6293a3fb-bc4d-442a-9dbe-694e73735d19 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.160572 May 12 17:21:45.688948 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 373/731] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:45 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:46.706193 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:46.706928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:46.713864 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:46.714315 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:46.715343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:46.715778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:46.842937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:46.852056 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:46.853702 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:46.854994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2706ecf8-b144-4bb2-b99c-3bdcb0be06f6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.152957 May 12 17:21:46.855629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 359/732] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:46 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:47.873446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:47.874048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:47.880447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:47.880890 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:47.881651 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:47.882078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:48.005408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:48.013302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:48.014834 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:48.016270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-677cb067-d1e7-443a-b251-374ea23efe87 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.146457 May 12 17:21:48.016836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 374/733] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:47 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:49.034609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:49.035209 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:49.041555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:49.041999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:49.042786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:49.043214 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:49.174042 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:49.182667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:49.184172 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:49.185448 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a039af23-3a15-4d1a-b9b5-e7847de203fa tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.154775 May 12 17:21:49.186294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 360/734] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:49 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:49.265391 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-b6c84a93-e1a7-4c8c-a679-0bcd2c54157a req-afb86ac2-ea79-4911-a107-5f0fc2d3a933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "name": "network-vif-plugged", "status": "completed", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:49.273391 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b6c84a93-e1a7-4c8c-a679-0bcd2c54157a req-afb86ac2-ea79-4911-a107-5f0fc2d3a933 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:49.273825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-b6c84a93-e1a7-4c8c-a679-0bcd2c54157a req-afb86ac2-ea79-4911-a107-5f0fc2d3a933 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:49.284247 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-b6c84a93-e1a7-4c8c-a679-0bcd2c54157a req-afb86ac2-ea79-4911-a107-5f0fc2d3a933 service nova] Creating event network-vif-plugged:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:21:49.290873 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-b6c84a93-e1a7-4c8c-a679-0bcd2c54157a req-afb86ac2-ea79-4911-a107-5f0fc2d3a933 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092105 May 12 17:21:49.291394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 375/735] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:50.203584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:50.204106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:50.214411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:50.214892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:50.215654 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:50.216091 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:50.341603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:50.349270 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:50.350809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:50.351953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-431b4260-5a10-48b9-b096-088797d077c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.152390 May 12 17:21:50.352512 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 361/736] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:50 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:51.371442 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:51.372130 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:51.378005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:51.378463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:51.379216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:51.379640 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:51.510478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:51.518225 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:51.519728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:51.520858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-64011028-8244-4ff9-afa1-ca351cf3fe1f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.154666 May 12 17:21:51.521416 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 376/737] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:51 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:52.539513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:52.540105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:52.546673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:52.547116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:52.547866 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:52.548292 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:52.673909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:52.682225 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:52.683758 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:52.684933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-78566fda-4e09-49f3-83c9-e2cd1572b1b1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.149837 May 12 17:21:52.685488 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 362/738] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:52 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:53.703484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:53.704017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:53.710915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:53.711360 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:53.712115 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:53.712543 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:53.837204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:53.844833 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:53.846325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:53.847558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8176986b-9f2c-4c84-948f-c466e16f6bc1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1730 microversion: 2.20 time: 0.148036 May 12 17:21:53.848178 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 377/739] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:53 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:54.865708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:54.866840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:54.873346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:54.873797 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:54.874601 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:54.875037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:54.998567 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:55.006264 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:55.008701 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:21:55.009839 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ced2c4e5-4e6a-48a4-96cb-573a83973bc0 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1717 microversion: 2.20 time: 0.148058 May 12 17:21:55.010399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 363/740] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:21:54 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1717 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:21:55.593367 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:55.594267 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:55.601164 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:55.601601 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:55.602347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:55.602798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:55.629966 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-08b8a361-2d70-4581-89f6-d1cc757b91a8 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 May 12 17:21:55.630528 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 378/741] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:21:55 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:55.641147 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:21:55.641689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:55.648496 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:55.649014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:55.649789 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:55.650280 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:55.679558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f91f6e57-f5e6-42da-b833-2b44255df4af tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/fdf27d07-2493-44e6-806d-6742e680b7b0" status: 200 len: 194 microversion: 2.1 time: 0.042503 May 12 17:21:55.680251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 364/742] 10.222.0.23 () {58 vars in 1412 bytes} [Thu May 12 17:21:55 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/fdf27d07-2493-44e6-806d-6742e680b7b0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:21:56.982943 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ee6803d-f5bb-4324-b54d-b1c919cb3224"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:21:56.983996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:21:56.990735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:56.991224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:56.991980 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:21:56.992406 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:21:57.232339 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-eda7e05b-2286-4a16-be3f-39964e2819eb tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "POST /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252922 May 12 17:21:57.233227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 379/743] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:21:56 2022] POST /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:04.715319 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:04.716294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:04.722772 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:04.723227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:04.724239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:04.724730 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:04.757077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1215445e-a5b8-419a-bd5e-d235efc819d9 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045571 May 12 17:22:04.757895 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 365/744] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:22:04 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:04.907446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:04.908050 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:04.915997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:04.916540 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:04.917217 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:04.917655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:04.945996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-059d2b40-2707-4e26-8404-d076a322a317 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/fdf27d07-2493-44e6-806d-6742e680b7b0" status: 200 len: 194 microversion: 2.1 time: 0.042924 May 12 17:22:04.946624 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 380/745] 10.222.0.23 () {58 vars in 1412 bytes} [Thu May 12 17:22:04 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/fdf27d07-2493-44e6-806d-6742e680b7b0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:04.956245 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:04.956726 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:04.963019 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:04.963467 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:04.964222 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:04.964649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:05.044010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lazy-loading 'services' on Instance uuid 49694a9c-8430-4914-828c-b11634c14ec8 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:22:05.113998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1943696c-0ee4-46c7-b22d-f2b272c68d5e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/fdf27d07-2493-44e6-806d-6742e680b7b0" status: 202 len: 0 microversion: 2.1 time: 0.161560 May 12 17:22:05.114654 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 366/746] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:22:04 2022] DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/fdf27d07-2493-44e6-806d-6742e680b7b0 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:22:06.233441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:06.233999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:06.240459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:06.240899 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:06.241650 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:06.242081 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:06.270346 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8e793337-0321-40e1-bbaf-009c964afc5c tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/6ee6803d-f5bb-4324-b54d-b1c919cb3224" status: 200 len: 194 microversion: 2.1 time: 0.040827 May 12 17:22:06.270955 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 381/747] 10.222.0.23 () {58 vars in 1412 bytes} [Thu May 12 17:22:06 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/6ee6803d-f5bb-4324-b54d-b1c919cb3224 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:06.281549 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:06.282125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:06.288212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:06.288660 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:06.289951 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:06.290383 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:06.367186 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lazy-loading 'services' on Instance uuid 49694a9c-8430-4914-828c-b11634c14ec8 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:22:06.434299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7ed9915c-5df5-41e8-a813-4bb2d4b93a31 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/6ee6803d-f5bb-4324-b54d-b1c919cb3224" status: 202 len: 0 microversion: 2.1 time: 0.157290 May 12 17:22:06.434922 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 367/748] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:22:06 2022] DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments/6ee6803d-f5bb-4324-b54d-b1c919cb3224 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:22:10.738145 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:10.739207 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:10.745400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:10.745848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:10.746664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:10.747103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:10.775392 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-266da1e1-ab74-4914-96e9-e901335ebf1f tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041115 May 12 17:22:10.775926 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 382/749] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:22:10 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:22:10.874885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:10.875923 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:10.882206 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:10.883459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:10.884251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:10.884679 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:10.912442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-445f96a0-e7cd-44c1-bab6-fd947df88ea6 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042252 May 12 17:22:10.912921 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 368/750] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:22:10 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:22:10.974394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:10.974905 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:10.980796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:10.981244 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:10.981999 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:10.982445 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:11.006972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Going to try to terminate instance {{(pid=117075) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:22:11.085388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-020c4c4e-bfb7-447c-91d3-988ebaf16cd0 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 204 len: 0 microversion: 2.1 time: 0.114283 May 12 17:22:11.086085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 383/751] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:22:10 2022] DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:22:11.094566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:11.095190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:11.100944 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:11.101387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:11.102133 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:11.102589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:11.229042 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:11.236218 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3d19e71f-c8fe-4488-8def-8b2f85763c59 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1675 microversion: 2.1 time: 0.145549 May 12 17:22:11.236771 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 369/752] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:11 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:12.255280 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:12.255972 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:12.263093 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:12.263531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:12.264276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:12.264698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:12.393744 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:12.401550 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f94e0f3d-940b-45a9-a766-ce9ed548f018 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1675 microversion: 2.1 time: 0.150720 May 12 17:22:12.402112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 384/753] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:12 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:13.420017 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:13.420566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:13.428307 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:13.428827 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:13.429514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:13.429991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:13.565622 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:13.573476 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-024c8329-0694-473d-addd-1843c852fbaa tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1675 microversion: 2.1 time: 0.158278 May 12 17:22:13.574260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 370/754] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:13 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:14.403951 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-ae269430-2173-4fc8-abeb-33e8d9c0b8c9 req-c85e7c5b-2e29-4187-9954-6d68f190cc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49694a9c-8430-4914-828c-b11634c14ec8", "name": "network-vif-deleted", "tag": "f22f77f1-5b40-44e2-bbd4-24054d6825ab"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:14.412090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-ae269430-2173-4fc8-abeb-33e8d9c0b8c9 req-c85e7c5b-2e29-4187-9954-6d68f190cc50 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:14.412531 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-ae269430-2173-4fc8-abeb-33e8d9c0b8c9 req-c85e7c5b-2e29-4187-9954-6d68f190cc50 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:14.424325 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-ae269430-2173-4fc8-abeb-33e8d9c0b8c9 req-c85e7c5b-2e29-4187-9954-6d68f190cc50 service nova] Creating event network-vif-deleted:f22f77f1-5b40-44e2-bbd4-24054d6825ab for instance 49694a9c-8430-4914-828c-b11634c14ec8 on hv-cinder-84159 May 12 17:22:14.429201 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-ae269430-2173-4fc8-abeb-33e8d9c0b8c9 req-c85e7c5b-2e29-4187-9954-6d68f190cc50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289687 May 12 17:22:14.430354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 385/755] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:14.590449 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:14.591895 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:14.600049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:14.600788 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:14.602252 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:14.603030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:14.640390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:14.644329 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:14.644795 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lazy-loading 'fault' on Instance uuid 49694a9c-8430-4914-828c-b11634c14ec8 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:22:14.695689 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f73a65ebe334405099f7a4f95c4a4df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e7bebb3ef2474591626aa0a76d7a1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:14.704873 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-024c467e-d93b-439a-aa20-fda8d62d04ec tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 200 len: 1328 microversion: 2.1 time: 0.118119 May 12 17:22:14.714553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 371/756] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:14 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:15.723931 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:15.724684 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:15.731185 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:15.731638 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:15.732398 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:15.732828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:15.747020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] HTTP exception thrown: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Request method failure captured: May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 HTTP/1.1 May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDgpFJqkbVgJgsBO1cnfbpqfukclWZ9WWrcG0UzVUwHKmed9ygGhMkB9mvs1NU4MDu12PHyPWZhFvuq-0mdT_rMGZQFBUFTKT7S6Zwd1GR4zxcLt7561WJaYYPD3hPe16ZpvbLgmKcKD8H3DzvdeFqPWzcNu14I5tde20ijWI0pitk May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:15.748695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: f73a65ebe334405099f7a4f95c4a4df6 May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:15.750256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '49694a9c-8430-4914-828c-b11634c14ec8'} May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:15.754852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:15.756741 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:15.759386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Returning 404 to user: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:15.759386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d52186e2-4f2e-45a6-a0e8-16116036a7ac tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 404 len: 111 microversion: 2.1 time: 0.030344 May 12 17:22:15.759386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 386/757] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:15 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:22:15.759839 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3496062b-56bc-4cd7-bf88-8c84cc8c4f17 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '.version_select at 0x7f78af3571f0>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:15.777857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3496062b-56bc-4cd7-bf88-8c84cc8c4f17 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113323179" status: 202 len: 0 microversion: 2.1 time: 0.022699 May 12 17:22:15.778752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 372/758] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 12 17:22:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113323179 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:22:18.628327 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:18.628931 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:18.635925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:18.636380 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:18.637150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:18.637588 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:18.651719 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] HTTP exception thrown: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Request method failure captured: May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 HTTP/1.1 May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDgpFJqkbVgJgsBO1cnfbpqfukclWZ9WWrcG0UzVUwHKmed9ygGhMkB9mvs1NU4MDu12PHyPWZhFvuq-0mdT_rMGZQFBUFTKT7S6Zwd1GR4zxcLt7561WJaYYPD3hPe16ZpvbLgmKcKD8H3DzvdeFqPWzcNu14I5tde20ijWI0pitk May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:18.653331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: f73a65ebe334405099f7a4f95c4a4df6 May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.654990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '49694a9c-8430-4914-828c-b11634c14ec8'} May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:18.656039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.657333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:18.670374 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Returning 404 to user: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:18.672191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7ad75b0a-829d-44c6-93a8-5aa35430f515 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 404 len: 111 microversion: 2.1 time: 0.047339 May 12 17:22:18.674497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 387/759] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:22:18 2022] DELETE /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:22:18.681912 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:18.682553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 49694a9c-8430-4914-828c-b11634c14ec8] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:18.694590 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:18.695123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:18.696600 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:18.697077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:18.710771 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] HTTP exception thrown: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Request method failure captured: May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 HTTP/1.1 May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDgpFJqkbVgJgsBO1cnfbpqfukclWZ9WWrcG0UzVUwHKmed9ygGhMkB9mvs1NU4MDu12PHyPWZhFvuq-0mdT_rMGZQFBUFTKT7S6Zwd1GR4zxcLt7561WJaYYPD3hPe16ZpvbLgmKcKD8H3DzvdeFqPWzcNu14I5tde20ijWI0pitk May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:18.712411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: f73a65ebe334405099f7a4f95c4a4df6 May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.713936 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '49694a9c-8430-4914-828c-b11634c14ec8'} May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:18.714905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. May 12 17:22:18.716412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:18.717809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Returning 404 to user: Instance 49694a9c-8430-4914-828c-b11634c14ec8 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:18.717809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f8cf3873-27d2-4123-b8f2-1653585de334 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8" status: 404 len: 111 microversion: 2.1 time: 0.036802 May 12 17:22:18.717809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 373/760] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:18 2022] GET /compute/v2.1/servers/49694a9c-8430-4914-828c-b11634c14ec8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:22:19.845845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:19.846365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:19.853181 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:19.853618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:19.854368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:19.854821 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:19.868381 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] HTTP exception thrown: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Request method failure captured: May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f HTTP/1.1 May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDgpFJqkbVgJgsBO1cnfbpqfukclWZ9WWrcG0UzVUwHKmed9ygGhMkB9mvs1NU4MDu12PHyPWZhFvuq-0mdT_rMGZQFBUFTKT7S6Zwd1GR4zxcLt7561WJaYYPD3hPe16ZpvbLgmKcKD8H3DzvdeFqPWzcNu14I5tde20ijWI0pitk May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:19.869894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: f73a65ebe334405099f7a4f95c4a4df6 May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.871485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '878603bd-9524-4a76-88c3-463a2f09910f'} May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:19.872277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.873591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:19.875443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Returning 404 to user: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:19.875443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-eca443be-1f0d-40da-9622-6726028b407e tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 404 len: 111 microversion: 2.1 time: 0.029241 May 12 17:22:19.875443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 388/761] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:22:19 2022] DELETE /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:22:19.879819 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:19.880433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] [instance: 878603bd-9524-4a76-88c3-463a2f09910f] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:19.887481 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:19.887927 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:19.888687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:19.889123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:19.902851 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] HTTP exception thrown: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Request method failure captured: May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f HTTP/1.1 May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDgpFJqkbVgJgsBO1cnfbpqfukclWZ9WWrcG0UzVUwHKmed9ygGhMkB9mvs1NU4MDu12PHyPWZhFvuq-0mdT_rMGZQFBUFTKT7S6Zwd1GR4zxcLt7561WJaYYPD3hPe16ZpvbLgmKcKD8H3DzvdeFqPWzcNu14I5tde20ijWI0pitk May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:19.904492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67e7bebb3ef2474591626aa0a76d7a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 67e7bebb3ef2474591626aa0a76d7a1d May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1241902557 May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: f73a65ebe334405099f7a4f95c4a4df6 May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeTestJSON-1241902557-project May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.905947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '878603bd-9524-4a76-88c3-463a2f09910f'} May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:19.906970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. May 12 17:22:19.908227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:19.909287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] Returning 404 to user: Instance 878603bd-9524-4a76-88c3-463a2f09910f could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:19.909287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ca1ee3ad-0590-4acc-b893-6accf3187e10 tempest-AttachVolumeTestJSON-1241902557 tempest-AttachVolumeTestJSON-1241902557-project] 10.222.0.23 "GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f" status: 404 len: 111 microversion: 2.1 time: 0.029825 May 12 17:22:19.909287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 374/762] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:19 2022] GET /compute/v2.1/servers/878603bd-9524-4a76-88c3-463a2f09910f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:22:24.725212 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4dd3d835-6400-485a-a6c3-5763339368d8 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Action: 'create', calling method: .version_select at 0x7f78aeb45670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-805013172", "metadata": {"Type": "work"}}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4dd3d835-6400-485a-a6c3-5763339368d8 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Request method failure captured: May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 121 May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJQUYjwFNMysU5PdgrPRqITtX1vsc6bUGk3NcjXgAYrUmRqHUAZjvd2htwuQM0_GyIc_KZiAcTbtcr-56d6eHKuhHV1GkgwWLQdLdwAbDE99uv8wY22jnCEZgy8uUth6vLGM65HWdZjrnkM1xXmNflpE1HZ_PRe64LupYMShz2opyY May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:24.733006 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 00858c9973b74073bc5a50847d073541 May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-805013172", "metadata": {"Type": "work"}}} May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: May 12 17:22:24.734587 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-805013172', 'metadata': {'Type': 'work'}}}} May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise error May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi '#$%' May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:24.735742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:22:24.737368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:22:24.738912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:22:24.738912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.738912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4dd3d835-6400-485a-a6c3-5763339368d8 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:24.738912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4dd3d835-6400-485a-a6c3-5763339368d8 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141499 May 12 17:22:24.738912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 389/763] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 12 17:22:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:24.744649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-438a3078-d225-4cab-bbd1-ba9ad385462d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Action: 'create', calling method: .version_select at 0x7f78af350430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-252347725", "metadata": {"Type": "work"}}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-438a3078-d225-4cab-bbd1-ba9ad385462d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Request method failure captured: May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 119 May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJQUYjwFNMysU5PdgrPRqITtX1vsc6bUGk3NcjXgAYrUmRqHUAZjvd2htwuQM0_GyIc_KZiAcTbtcr-56d6eHKuhHV1GkgwWLQdLdwAbDE99uv8wY22jnCEZgy8uUth6vLGM65HWdZjrnkM1xXmNflpE1HZ_PRe64LupYMShz2opyY May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:24.747761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 00858c9973b74073bc5a50847d073541 May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-252347725", "metadata": {"Type": "work"}}} May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: May 12 17:22:24.749262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-252347725', 'metadata': {'Type': 'work'}}}} May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise error May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi '0' May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:24.750454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:22:24.752041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:22:24.753226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:22:24.753226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.753226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-438a3078-d225-4cab-bbd1-ba9ad385462d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:24.753226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-438a3078-d225-4cab-bbd1-ba9ad385462d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008826 May 12 17:22:24.753226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 375/764] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 12 17:22:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:24.759269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-84817f68-1d3c-4d3c-99f4-26c7a3a2b844 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Action: 'create', calling method: .version_select at 0x7f78aebd2160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-575339974", "metadata": {"Type": "work"}}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-84817f68-1d3c-4d3c-99f4-26c7a3a2b844 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Request method failure captured: May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 118 May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJQUYjwFNMysU5PdgrPRqITtX1vsc6bUGk3NcjXgAYrUmRqHUAZjvd2htwuQM0_GyIc_KZiAcTbtcr-56d6eHKuhHV1GkgwWLQdLdwAbDE99uv8wY22jnCEZgy8uUth6vLGM65HWdZjrnkM1xXmNflpE1HZ_PRe64LupYMShz2opyY May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:24.762394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 00858c9973b74073bc5a50847d073541 May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-575339974", "metadata": {"Type": "work"}}} May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: May 12 17:22:24.763938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-575339974', 'metadata': {'Type': 'work'}}}} May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise error May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi '' May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:24.765302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:22:24.767048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:22:24.768668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:22:24.768668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.768668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-84817f68-1d3c-4d3c-99f4-26c7a3a2b844 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:24.768668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-84817f68-1d3c-4d3c-99f4-26c7a3a2b844 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009072 May 12 17:22:24.768668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 390/765] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 12 17:22:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:24.772617 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2e07db59-f200-45a2-9707-10ae00261b4d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Calling method '.version_select at 0x7f78af368c10>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:24.801269 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-2e07db59-f200-45a2-9707-10ae00261b4d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] HTTP exception thrown: Volume tempest-invalid-1417016516 could not be found. May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2e07db59-f200-45a2-9707-10ae00261b4d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Request method failure captured: May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1417016516 HTTP/1.1 May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJQUYjwFNMysU5PdgrPRqITtX1vsc6bUGk3NcjXgAYrUmRqHUAZjvd2htwuQM0_GyIc_KZiAcTbtcr-56d6eHKuhHV1GkgwWLQdLdwAbDE99uv8wY22jnCEZgy8uUth6vLGM65HWdZjrnkM1xXmNflpE1HZ_PRe64LupYMShz2opyY May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:24.803262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 00858c9973b74073bc5a50847d073541 May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Volume tempest-invalid-1417016516 could not be found. May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': 'tempest-invalid-1417016516'} May 12 17:22:24.805240 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1417016516 could not be found. (HTTP 404) (Request-ID: req-74cc9611-3b22-4737-aaa3-68c3b69d1f92) May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.806014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:22:24.807390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1417016516 could not be found. May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:24.809010 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1417016516 could not be found. May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1417016516 could not be found. May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2e07db59-f200-45a2-9707-10ae00261b4d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Returning 404 to user: Volume tempest-invalid-1417016516 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2e07db59-f200-45a2-9707-10ae00261b4d tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1417016516" status: 404 len: 99 microversion: 2.1 time: 0.035999 May 12 17:22:24.810615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 376/766] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 12 17:22:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1417016516 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 17:22:24.814929 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d602e806-86f0-4a17-af6c-98847374e8d6 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003748 May 12 17:22:24.815468 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 391/767] 10.222.0.23 () {58 vars in 1139 bytes} [Thu May 12 17:22:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 17:22:24.823761 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-fabf09b1-ae47-4827-b335-3fc349d89982 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003701 May 12 17:22:24.824244 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 377/768] 10.222.0.23 () {58 vars in 1136 bytes} [Thu May 12 17:22:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 17:22:24.831968 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e5776c28-9e29-4912-bc60-81d8c99b17e4 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Calling method '.version_select at 0x7f78aed96e50>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:24.858798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-e5776c28-9e29-4912-bc60-81d8c99b17e4 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] HTTP exception thrown: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e5776c28-9e29-4912-bc60-81d8c99b17e4 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Request method failure captured: May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/os-volumes/309cef48-48fd-47d5-9f26-3843cf30ec09 HTTP/1.1 May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJQUYjwFNMysU5PdgrPRqITtX1vsc6bUGk3NcjXgAYrUmRqHUAZjvd2htwuQM0_GyIc_KZiAcTbtcr-56d6eHKuhHV1GkgwWLQdLdwAbDE99uv8wY22jnCEZgy8uUth6vLGM65HWdZjrnkM1xXmNflpE1HZ_PRe64LupYMShz2opyY May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:24.860695 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 00858c9973b74073bc5a50847d073541 May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '309cef48-48fd-47d5-9f26-3843cf30ec09'} May 12 17:22:24.862205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. (HTTP 404) (Request-ID: req-4387cd03-1b11-43ca-a03b-6b77a8945522) May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.863197 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:22:24.864364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:22:24.867799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e5776c28-9e29-4912-bc60-81d8c99b17e4 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Returning 404 to user: Volume 309cef48-48fd-47d5-9f26-3843cf30ec09 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e5776c28-9e29-4912-bc60-81d8c99b17e4 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/309cef48-48fd-47d5-9f26-3843cf30ec09" status: 404 len: 109 microversion: 2.1 time: 0.033556 May 12 17:22:24.870085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 392/769] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:22:24 2022] DELETE /compute/v2.1/os-volumes/309cef48-48fd-47d5-9f26-3843cf30ec09 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:22:24.872112 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2f162ad8-ea56-4f23-80ff-e7e6dafb8c23 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Calling method '.version_select at 0x7f78af3bf670>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:24.898183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-2f162ad8-ea56-4f23-80ff-e7e6dafb8c23 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] HTTP exception thrown: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2f162ad8-ea56-4f23-80ff-e7e6dafb8c23 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Request method failure captured: May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/os-volumes/343061ab-0c24-47fd-b1ca-c62f5048cdfa HTTP/1.1 May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJQUYjwFNMysU5PdgrPRqITtX1vsc6bUGk3NcjXgAYrUmRqHUAZjvd2htwuQM0_GyIc_KZiAcTbtcr-56d6eHKuhHV1GkgwWLQdLdwAbDE99uv8wY22jnCEZgy8uUth6vLGM65HWdZjrnkM1xXmNflpE1HZ_PRe64LupYMShz2opyY May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:24.900327 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91a743da8b174f4ca8f07962a758cdd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 91a743da8b174f4ca8f07962a758cdd3 May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesNegativeTest-101884494 May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 00858c9973b74073bc5a50847d073541 May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesNegativeTest-101884494-project May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '343061ab-0c24-47fd-b1ca-c62f5048cdfa'} May 12 17:22:24.901871 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. (HTTP 404) (Request-ID: req-7b01a311-b331-45a9-8501-f066217bd6bc) May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.902849 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:22:24.904257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:22:24.905676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2f162ad8-ea56-4f23-80ff-e7e6dafb8c23 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] Returning 404 to user: Volume 343061ab-0c24-47fd-b1ca-c62f5048cdfa could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2f162ad8-ea56-4f23-80ff-e7e6dafb8c23 tempest-VolumesNegativeTest-101884494 tempest-VolumesNegativeTest-101884494-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/343061ab-0c24-47fd-b1ca-c62f5048cdfa" status: 404 len: 109 microversion: 2.1 time: 0.033436 May 12 17:22:24.907041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 378/770] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:22:24 2022] GET /compute/v2.1/os-volumes/343061ab-0c24-47fd-b1ca-c62f5048cdfa => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:22:28.120013 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:28.120991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:28.127497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:28.127945 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:28.128707 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:28.129138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:28.158085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b0ec2b17-b170-4015-883e-64934504bd21 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043776 May 12 17:22:28.158661 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 393/771] 10.222.0.23 () {60 vars in 1342 bytes} [Thu May 12 17:22:28 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:28.219023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:28.219516 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:28.226069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:28.227186 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:28.228081 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:28.228553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:28.255487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:22:28.340348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-262024cb-5413-46d4-a56c-5dfe2c4f6748 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 204 len: 0 microversion: 2.20 time: 0.126274 May 12 17:22:28.340924 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 379/772] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 12 17:22:28 2022] DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:22:28.350898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:28.352095 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:28.362582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:28.362582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:28.362582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:28.362801 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:28.502480 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:28.510958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:28.512683 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:28.514331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-63945597-0001-459e-8a15-2760bc8f5d4f tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.168879 May 12 17:22:28.514845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 394/773] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:28 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:22:29.533148 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:29.533854 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:29.541000 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:29.541476 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:29.542228 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:29.542684 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:29.669319 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:29.679324 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:29.681368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:29.682559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-fbbcf76b-600d-4b05-b401-bb126284ec47 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1723 microversion: 2.20 time: 0.153696 May 12 17:22:29.683118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 380/774] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:29 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:22:30.689618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-f7bbad37-887d-4a4c-9879-9f9fa02263b5 req-e38c6bd2-e605-4aea-9c5b-6219649b19c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4eae9c-c6d1-4dc2-8039-344c3c7af142", "name": "network-vif-deleted", "tag": "b3499779-a985-44de-b351-0cf1eafb3c90"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:30.708838 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:30.709605 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:30.735431 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:30.735883 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:30.736663 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:30.737090 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:30.740662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-f7bbad37-887d-4a4c-9879-9f9fa02263b5 req-e38c6bd2-e605-4aea-9c5b-6219649b19c1 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:30.741322 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-f7bbad37-887d-4a4c-9879-9f9fa02263b5 req-e38c6bd2-e605-4aea-9c5b-6219649b19c1 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:30.770304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-f7bbad37-887d-4a4c-9879-9f9fa02263b5 req-e38c6bd2-e605-4aea-9c5b-6219649b19c1 service nova] Creating event network-vif-deleted:b3499779-a985-44de-b351-0cf1eafb3c90 for instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 on hv-cinder-84159 May 12 17:22:30.780627 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-f7bbad37-887d-4a4c-9879-9f9fa02263b5 req-e38c6bd2-e605-4aea-9c5b-6219649b19c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095005 May 12 17:22:30.785010 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 395/775] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:30.846001 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:30.857722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:30.859581 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:30.860931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-483671aa-9994-4e8c-af42-c5f7da3ef31b tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1365 microversion: 2.20 time: 0.164006 May 12 17:22:30.861786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 381/776] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:30 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:22:31.882126 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:31.883284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:31.889634 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:31.890075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:31.890862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:31.891292 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:31.922563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:31.922563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:31.922563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lazy-loading 'fault' on Instance uuid 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:22:31.970296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:31.978441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:31.979925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:31.981054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-aebe2d39-8eaf-4ea9-982f-3492cb6b28c6 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1370 microversion: 2.20 time: 0.103611 May 12 17:22:31.981610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 396/777] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:31 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:22:32.998920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:32.999613 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:33.005882 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:33.006396 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:33.007191 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:33.007898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:33.040535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:33.040984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:33.041425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lazy-loading 'fault' on Instance uuid 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:22:33.081440 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:33.089653 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:33.091213 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39a6070dad2d4b0e8d9c4004a396a66e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f96cd34d1bc46b78a000e0b5af9d6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:33.092352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1ef76506-bdc9-43d3-9a61-bdeead7da4b5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 200 len: 1370 microversion: 2.20 time: 0.097391 May 12 17:22:33.092904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 382/778] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:32 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:22:34.110267 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:34.110849 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:34.117785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:34.118235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:34.119044 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:34.119475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:34.133921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] HTTP exception thrown: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Request method failure captured: May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 HTTP/1.1 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDQo9diWWCBJmUQ-j3les2qmEUE8lZTHF7p4GqdbI_b6s-P8sEh8yCjj6Twrc6C0hZ4CbLP8h6zXIyJ9T2j1pZLeLtjlxwii5iJkjjVAPSGQHagTBlvmjGk3b-G9IJlnHA0YeOSyr5JGjUFfXiAKotjJSSjzBcMhVBazz-npHdr0-A May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:34.135560 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 39a6070dad2d4b0e8d9c4004a396a66e May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:34.137235 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '2c4eae9c-c6d1-4dc2-8039-344c3c7af142'} May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:34.138133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:34.139767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:34.141149 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Returning 404 to user: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:34.141149 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ac97fbb4-931d-4f67-83b7-0799833a56e1 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 404 len: 111 microversion: 2.20 time: 0.030568 May 12 17:22:34.141149 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 397/779] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:34 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:34.145631 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-199c1846-72e2-45dd-8639-12d63ebfdcf5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '.version_select at 0x7f78af2ff9d0>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:34.163292 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-199c1846-72e2-45dd-8639-12d63ebfdcf5 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962514658" status: 204 len: 0 microversion: 2.20 time: 0.021380 May 12 17:22:34.164388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 383/780] 10.222.0.23 () {60 vars in 1261 bytes} [Thu May 12 17:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962514658 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 17:22:35.939775 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:35.940323 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:35.946822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:35.947269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:35.948027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:35.948459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:35.961947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] HTTP exception thrown: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Request method failure captured: May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 HTTP/1.1 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDQo9diWWCBJmUQ-j3les2qmEUE8lZTHF7p4GqdbI_b6s-P8sEh8yCjj6Twrc6C0hZ4CbLP8h6zXIyJ9T2j1pZLeLtjlxwii5iJkjjVAPSGQHagTBlvmjGk3b-G9IJlnHA0YeOSyr5JGjUFfXiAKotjJSSjzBcMhVBazz-npHdr0-A May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:35.963723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 39a6070dad2d4b0e8d9c4004a396a66e May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:35.965441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '2c4eae9c-c6d1-4dc2-8039-344c3c7af142'} May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:35.970060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:35.971681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:35.973188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Returning 404 to user: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:35.973188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8decb969-f578-4be0-af63-b4897cb64384 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 404 len: 111 microversion: 2.20 time: 0.029052 May 12 17:22:35.973188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 398/781] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 12 17:22:35 2022] DELETE /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:35.974059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:35.974954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 2c4eae9c-c6d1-4dc2-8039-344c3c7af142] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:35.981052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:35.981498 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:35.982285 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:35.982788 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:35.996034 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] HTTP exception thrown: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Request method failure captured: May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 HTTP/1.1 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDQo9diWWCBJmUQ-j3les2qmEUE8lZTHF7p4GqdbI_b6s-P8sEh8yCjj6Twrc6C0hZ4CbLP8h6zXIyJ9T2j1pZLeLtjlxwii5iJkjjVAPSGQHagTBlvmjGk3b-G9IJlnHA0YeOSyr5JGjUFfXiAKotjJSSjzBcMhVBazz-npHdr0-A May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:35.998156 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 39a6070dad2d4b0e8d9c4004a396a66e May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:36.000170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '2c4eae9c-c6d1-4dc2-8039-344c3c7af142'} May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:36.004304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. May 12 17:22:36.005892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:36.008420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Returning 404 to user: Instance 2c4eae9c-c6d1-4dc2-8039-344c3c7af142 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:36.008420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-02b852bd-aa5f-4769-b629-df7038644bdd tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142" status: 404 len: 111 microversion: 2.20 time: 0.030187 May 12 17:22:36.008420 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 384/782] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:35 2022] GET /compute/v2.1/servers/2c4eae9c-c6d1-4dc2-8039-344c3c7af142 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:37.138316 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:37.138835 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:37.147526 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:37.148151 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:37.148933 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:37.149370 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:37.163276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] HTTP exception thrown: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Request method failure captured: May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 HTTP/1.1 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUDQo9diWWCBJmUQ-j3les2qmEUE8lZTHF7p4GqdbI_b6s-P8sEh8yCjj6Twrc6C0hZ4CbLP8h6zXIyJ9T2j1pZLeLtjlxwii5iJkjjVAPSGQHagTBlvmjGk3b-G9IJlnHA0YeOSyr5JGjUFfXiAKotjJSSjzBcMhVBazz-npHdr0-A May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:22:37.165331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 39a6070dad2d4b0e8d9c4004a396a66e May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.166799 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '47998668-5296-4019-a02c-3c80e30ff266'} May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:37.167539 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.168794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:22:37.170625 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Returning 404 to user: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:37.172166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ecddc188-7e77-4f48-b83d-680c3fc98c94 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 404 len: 111 microversion: 2.20 time: 0.032378 May 12 17:22:37.172738 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 399/783] 10.222.0.23 () {60 vars in 1279 bytes} [Thu May 12 17:22:37 2022] DELETE /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:37.181893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:37.181893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] [instance: 47998668-5296-4019-a02c-3c80e30ff266] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:37.188054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:37.188502 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:37.189256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:37.189692 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:37.202834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] HTTP exception thrown: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Request method failure captured: May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 HTTP/1.1 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUDQo9diWWCBJmUQ-j3les2qmEUE8lZTHF7p4GqdbI_b6s-P8sEh8yCjj6Twrc6C0hZ4CbLP8h6zXIyJ9T2j1pZLeLtjlxwii5iJkjjVAPSGQHagTBlvmjGk3b-G9IJlnHA0YeOSyr5JGjUFfXiAKotjJSSjzBcMhVBazz-npHdr0-A May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:22:37.204343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f96cd34d1bc46b78a000e0b5af9d6a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 9f96cd34d1bc46b78a000e0b5af9d6a2 May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-423506411 May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 39a6070dad2d4b0e8d9c4004a396a66e May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-423506411-project May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.206018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '47998668-5296-4019-a02c-3c80e30ff266'} May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:22:37.207076 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. May 12 17:22:37.208645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:22:37.212723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] Returning 404 to user: Instance 47998668-5296-4019-a02c-3c80e30ff266 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:22:37.212723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1db8332f-8169-4409-b8f3-0a9c77ec7544 tempest-AttachVolumeShelveTestJSON-423506411 tempest-AttachVolumeShelveTestJSON-423506411-project] 10.222.0.23 "GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266" status: 404 len: 111 microversion: 2.20 time: 0.029017 May 12 17:22:37.212723 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 385/784] 10.222.0.23 () {60 vars in 1276 bytes} [Thu May 12 17:22:37 2022] GET /compute/v2.1/servers/47998668-5296-4019-a02c-3c80e30ff266 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:22:47.200186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c4cf826c-8aff-4422-b8b2-3be7ec18bf0c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: .version_select at 0x7f78aeb6bc10>, body: {"keypair": {"name": "tempest-keypair-2085778224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEd0kQrCmnfXRGolTL42siHXkRcy6NEZw9UrARtUam0aAh7p74mZBy6xw8AMwlFulvx/JTO0AiUbQl4T5snobdVCWQv1NxpO2ASr4k61qesKJV093DGsMhG1qMK7ooWGg=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:47.216304 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-c4cf826c-8aff-4422-b8b2-3be7ec18bf0c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:22:47.227898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-c4cf826c-8aff-4422-b8b2-3be7ec18bf0c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:22:47.255818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c4cf826c-8aff-4422-b8b2-3be7ec18bf0c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197754 May 12 17:22:47.256849 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 400/785] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:22:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:48.606817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1160102365", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfb02df-5940-4251-8c77-308786c51833"}], "security_groups": [{"name": "tempest-securitygroup--1097448829"}], "key_name": "tempest-keypair-2085778224", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:54.605326 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] validate_networks() for [('fcfb02df-5940-4251-8c77-308786c51833', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:22:55.109494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:22:55.109918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:22:55.110385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:22:55.112011 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:22:55.112436 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:22:55.123256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.124917 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.125751 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.126187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.138497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:55.138998 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:55.145904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.146362 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.147174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.147840 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.154257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:22:55.158653 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:22:55.173527 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:22:55.176416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:22:55.178464 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Going to try to terminate instance {{(pid=117075) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:22:55.229991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e2bfe753-01dd-4e3a-bec8-f26dd1c616f6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.628012 May 12 17:22:55.231520 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 386/786] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:22:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 6631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:22:55.237680 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-ae8c81bd-78f8-414c-8f34-bb3d5cf43369 req-c561ebbb-be82-4c72-a9a6-c640702cb7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:55.248277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ae8c81bd-78f8-414c-8f34-bb3d5cf43369 req-c561ebbb-be82-4c72-a9a6-c640702cb7a8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.250892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ae8c81bd-78f8-414c-8f34-bb3d5cf43369 req-c561ebbb-be82-4c72-a9a6-c640702cb7a8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.264581 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-82c1d374-f907-42fe-9b39-98377dd6866b tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 204 len: 0 microversion: 2.1 time: 0.129852 May 12 17:22:55.264848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-ae8c81bd-78f8-414c-8f34-bb3d5cf43369 req-c561ebbb-be82-4c72-a9a6-c640702cb7a8 service nova] Creating event network-changed:b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3 for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf on hv-cinder-84159 May 12 17:22:55.268712 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 401/787] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:22:55 2022] DELETE /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:22:55.270318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-ae8c81bd-78f8-414c-8f34-bb3d5cf43369 req-c561ebbb-be82-4c72-a9a6-c640702cb7a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037373 May 12 17:22:55.271406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 387/788] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:55.273909 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-22ce8e75-fa81-46bc-994e-f532c93374bf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:55.274664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-22ce8e75-fa81-46bc-994e-f532c93374bf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:55.278515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:55.290996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:55.304471 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.305338 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.306845 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:55.307591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:55.336249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-22ce8e75-fa81-46bc-994e-f532c93374bf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:55.343483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-22ce8e75-fa81-46bc-994e-f532c93374bf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1242 microversion: 2.1 time: 0.076297 May 12 17:22:55.344072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 402/789] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:55 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:55.464555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:55.473105 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d461c9d0-47d7-440a-a38a-08588f15589a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.199353 May 12 17:22:55.474007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 388/790] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:55 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:56.359963 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:56.360489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:56.367904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:56.368355 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:56.369128 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:56.369575 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:56.430668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:56.437818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4db96089-65f3-4210-9bcd-1bb59aa77c4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1246 microversion: 2.1 time: 0.081825 May 12 17:22:56.438372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 403/791] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:56 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:56.490996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:56.491599 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:56.497806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:56.498248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:56.499033 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:56.499459 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:56.644554 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:56.652716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3f3529f8-cead-4402-b821-d8f324c581ce tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.165506 May 12 17:22:56.653513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 389/792] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:56 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:57.454924 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:57.455561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:57.462056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:57.462545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:57.463406 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:57.463842 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:57.552993 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:57.561329 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4d16e0a3-1477-4370-bed8-11e69c4fcf5a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1294 microversion: 2.1 time: 0.109920 May 12 17:22:57.571788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 404/793] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:57 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1294 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:57.669267 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:57.670566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:57.676653 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:57.677200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:57.678044 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:57.679123 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:57.962448 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:57.969978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ac301608-97a6-413d-8193-755a6ba8427a tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1568 microversion: 2.1 time: 0.304596 May 12 17:22:57.971385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 390/794] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:57 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:22:58.142806 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-977719764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1239243642", "security_groups": [{"name": "tempest-secgroup-smoke-206222092"}], "block_device_mapping_v2": [{"uuid": "b311310e-94b1-4337-8daf-8fcb3b579851", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6fb55941-2cb2-4359-bdd6-587e053b44f0"}]}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:58.264070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] validate_networks() for [('6fb55941-2cb2-4359-bdd6-587e053b44f0', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:22:58.406117 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-ee6d7888-e232-4d56-b082-517a591f7df7 req-e79f165a-a94e-4036-ab4a-a453cf39484e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf", "name": "network-vif-deleted", "tag": "b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:22:58.416201 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ee6d7888-e232-4d56-b082-517a591f7df7 req-e79f165a-a94e-4036-ab4a-a453cf39484e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:58.416693 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ee6d7888-e232-4d56-b082-517a591f7df7 req-e79f165a-a94e-4036-ab4a-a453cf39484e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:58.433306 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-ee6d7888-e232-4d56-b082-517a591f7df7 req-e79f165a-a94e-4036-ab4a-a453cf39484e service nova] Creating event network-vif-deleted:b8bf9fa4-9a67-47d7-aeac-ce0a717c81d3 for instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf on hv-cinder-84159 May 12 17:22:58.438195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-ee6d7888-e232-4d56-b082-517a591f7df7 req-e79f165a-a94e-4036-ab4a-a453cf39484e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116465 May 12 17:22:58.438996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 391/795] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:22:58.579986 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:58.580602 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:58.587782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:58.588230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:58.589095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:58.589709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:58.677983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:58.689318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9903c320-f096-4ed9-ba34-f0638a3b6163 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1300 microversion: 2.1 time: 0.113583 May 12 17:22:58.691613 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 392/796] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:58 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:22:58.754767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:22:58.755414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:22:58.756001 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:22:58.757044 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:22:58.757559 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:22:58.767944 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:58.768545 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:58.769460 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:58.770188 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:58.791344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for project 5d002d9e79b24742b0906bc2b220d998. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:22:58.796011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Getting quotas for user 845032b55cfa40ad9fcd8b14782483d5 and project 5d002d9e79b24742b0906bc2b220d998. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:22:58.904386 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:22:58.907218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b311310e-94b1-4337-8daf-8fcb3b579851',volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:22:58.988678 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:58.989287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:59.000665 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:59.001309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:59.002321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:59.003103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:59.068897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:59.072065 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:59.072065 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lazy-loading 'fault' on Instance uuid f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:22:59.108546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-de7fc459-c9f6-4e31-b5e4-304e853e4844 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.969130 May 12 17:22:59.109952 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 405/797] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:22:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:22:59.121344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-83bb3921-e1c9-475b-9d77-45dae1cef478 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:59.122191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-83bb3921-e1c9-475b-9d77-45dae1cef478 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:59.151265 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '918a2e8acb8449dcbc3c137f3452d51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3127460c8042473294d90b9a3338a273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:59.170495 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b7051286-0f12-45f6-afd2-33ec2183acd6 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 200 len: 1223 microversion: 2.1 time: 0.186701 May 12 17:22:59.172835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 393/798] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:58 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 1223 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:22:59.200088 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-83bb3921-e1c9-475b-9d77-45dae1cef478 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:59.209883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-83bb3921-e1c9-475b-9d77-45dae1cef478 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1094 microversion: 2.1 time: 0.093708 May 12 17:22:59.210236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 406/799] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:59 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:22:59.709196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:22:59.710291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:22:59.718166 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:59.718917 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:59.719986 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:22:59.727851 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:22:59.901753 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:22:59.909787 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-fa5e882e-5186-4541-a3a0-ac20eb3e52da tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.205043 May 12 17:22:59.910360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 394/800] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:22:59 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:00.191953 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:00.193245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] [instance: f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:00.201147 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.201876 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:00.202701 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.203174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:00.219616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] HTTP exception thrown: Instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf could not be found. May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Request method failure captured: May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf HTTP/1.1 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUEu8sImt33UtgAtHzEBN4D4kKMauArQKaQ4ECZcNvmkML4xE4c6KFv2_9A87Q86T8RqiQybf67lEIYG9YE84uU_913Nuix9OZP4zhyjQA--h9gNYyPav5VhgE4cfxI3AETX3Uvz_mfujAkYChBDBQCPrGVLMTusxzYkGJJdjryT0o8 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 3127460c8042473294d90b9a3338a273 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-TestShelveInstance-945602113 May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:23:00.221470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3127460c8042473294d90b9a3338a273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3127460c8042473294d90b9a3338a273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3127460c8042473294d90b9a3338a273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3127460c8042473294d90b9a3338a273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-TestShelveInstance-945602113 May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 3127460c8042473294d90b9a3338a273 May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-TestShelveInstance-945602113 May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-TestShelveInstance-945602113-project May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 918a2e8acb8449dcbc3c137f3452d51b May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-TestShelveInstance-945602113-project May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf could not be found. May 12 17:23:00.223079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': 'f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf'} May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf could not be found. May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:23:00.224107 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf could not be found. May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf could not be found. May 12 17:23:00.225474 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:23:00.226959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Returning 404 to user: Instance f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:23:00.226959 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8d170d2a-383d-49ad-8a61-2fd72abe1725 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf" status: 404 len: 111 microversion: 2.1 time: 0.037207 May 12 17:23:00.231752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:00.232378 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:00.243982 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 407/801] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:00 2022] GET /compute/v2.1/servers/f56f36d8-2e2b-4024-b0e1-d31b9b7f08bf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:23:00.245379 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.246002 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:00.246981 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.247609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:00.349193 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:00.356404 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9d297a4e-6a7f-474f-bef3-4e0db8537980 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1210 microversion: 2.1 time: 0.133350 May 12 17:23:00.356985 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 395/802] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:00 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:00.420138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-91d9124a-fc40-4367-ae8b-1a263b4d8fb9 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] Calling method '.version_select at 0x7f78aeb64c10>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:00.445601 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-91d9124a-fc40-4367-ae8b-1a263b4d8fb9 tempest-TestShelveInstance-945602113 tempest-TestShelveInstance-945602113-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-713223441" status: 202 len: 0 microversion: 2.1 time: 0.029374 May 12 17:23:00.447311 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 408/803] 10.222.0.23 () {58 vars in 1250 bytes} [Thu May 12 17:23:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-713223441 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:23:00.456483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-22dec655-0200-4d1b-a2c0-432a619c2af7 req-e8b81cf1-8fb2-4e1f-9396-26994626e0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95312fe9-ef90-4c74-ba58-31abb0fdd309", "tag": "ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:00.464304 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-22dec655-0200-4d1b-a2c0-432a619c2af7 req-e8b81cf1-8fb2-4e1f-9396-26994626e0fc service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.465024 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-22dec655-0200-4d1b-a2c0-432a619c2af7 req-e8b81cf1-8fb2-4e1f-9396-26994626e0fc service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:00.476722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-22dec655-0200-4d1b-a2c0-432a619c2af7 req-e8b81cf1-8fb2-4e1f-9396-26994626e0fc service nova] Creating event network-changed:ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d for instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 on hv-cinder-84159 May 12 17:23:00.482243 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-22dec655-0200-4d1b-a2c0-432a619c2af7 req-e8b81cf1-8fb2-4e1f-9396-26994626e0fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029694 May 12 17:23:00.484067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 396/804] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:23:00.931091 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:00.933115 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:00.941677 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.942588 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:00.944032 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:00.944698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:01.186567 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:01.194755 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d461ad71-ba2d-4d1a-bdfd-c927c35b4b6b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.271041 May 12 17:23:01.195343 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 409/805] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:00 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:01.373568 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:01.374937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:01.383373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:01.384109 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:01.385049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:01.385676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:01.531490 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:01.541299 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-76dd6a2b-2d4b-4127-b417-f248c50b2236 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.171542 May 12 17:23:01.546804 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 397/806] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:01 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:02.212281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:02.213633 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:02.227182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:02.227950 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:02.230408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:02.231099 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:02.396011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:02.407518 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e762462e-2c94-4f89-a3bc-7e6736e3dbf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.199693 May 12 17:23:02.408864 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 410/807] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:02 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:02.561073 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:02.562504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:02.569560 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:02.570109 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:02.570928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:02.571584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:02.974970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:02.982250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-298fbcbc-dbba-465b-9cc3-c9f7e9f238f6 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.425632 May 12 17:23:02.982857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 398/808] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:02 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:03.425205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:03.427514 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:03.438475 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:03.439036 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:03.439800 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:03.440132 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:03.580716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:03.589162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8cb6d26d-212a-4db5-a422-027af189ca55 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.167645 May 12 17:23:03.596144 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 411/809] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:03 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:03.713814 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-a5901374-c1a3-43dc-a481-a8b9a3c62fda req-92da691f-925a-446f-8dad-31ae380471eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c547832-2add-4148-8b83-baf4e11d5f36", "tag": "aab0755a-1de0-423e-bdf8-9d264bcf1f30"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:03.730605 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a5901374-c1a3-43dc-a481-a8b9a3c62fda req-92da691f-925a-446f-8dad-31ae380471eb service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:03.731979 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a5901374-c1a3-43dc-a481-a8b9a3c62fda req-92da691f-925a-446f-8dad-31ae380471eb service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:03.746889 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-a5901374-c1a3-43dc-a481-a8b9a3c62fda req-92da691f-925a-446f-8dad-31ae380471eb service nova] Creating event network-changed:aab0755a-1de0-423e-bdf8-9d264bcf1f30 for instance 2c547832-2add-4148-8b83-baf4e11d5f36 on hv-cinder-84159 May 12 17:23:03.752271 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-a5901374-c1a3-43dc-a481-a8b9a3c62fda req-92da691f-925a-446f-8dad-31ae380471eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044446 May 12 17:23:03.753515 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 399/810] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:03.999438 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:04.000010 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:04.005758 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:04.006202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:04.007050 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:04.007479 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:04.224554 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:04.238880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6d8e690b-5d7b-4fcb-8985-e335fd2f214f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.243665 May 12 17:23:04.249586 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 412/811] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:03 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:04.607982 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:04.608757 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:04.614909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:04.615359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:04.616129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:04.616559 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:04.762737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:04.770567 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-306d1321-c4cc-4add-a4b7-6ce152721fab tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.166967 May 12 17:23:04.771082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 400/812] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:04 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:05.260211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:05.260946 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:05.267400 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:05.267944 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:05.268914 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:05.269372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:05.397043 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:05.404942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-33147a32-f51c-4ca0-a33e-25fd88b061ab tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.151627 May 12 17:23:05.405502 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 413/813] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:05 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:05.788098 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:05.789255 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:05.805537 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:05.805995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:05.806816 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:05.807253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:06.421813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:06.422403 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:06.429174 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:06.429615 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:06.430447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:06.430922 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:06.518278 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:06.525341 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b66d91d1-3851-4956-bae0-f336b2f381e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.741269 May 12 17:23:06.525918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 401/814] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:05 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:06.583080 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:06.591245 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a8bad0f7-b743-45e4-8f44-c9607aae2de4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.173305 May 12 17:23:06.591904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 414/815] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:06 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:07.543694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:07.544628 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:07.551461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:07.552130 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:07.553116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:07.553727 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:07.611206 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:07.612069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:07.633249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:07.635151 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:07.636085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:07.636564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:07.719711 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:07.727064 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5fab1a83-9845-41f3-a551-cd8b93bea640 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.187927 May 12 17:23:07.727639 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 402/816] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:07 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:07.908481 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:07.915949 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6fcc4f9b-ae11-44f3-8d85-594d1443ff80 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.310260 May 12 17:23:07.919127 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 415/817] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:07 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:08.463991 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-ad00618f-1e49-42b2-9529-0fe1cd379f49 req-1bc21dc2-0c3e-444f-8d4d-b03559492ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95312fe9-ef90-4c74-ba58-31abb0fdd309", "name": "network-vif-plugged", "status": "completed", "tag": "ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:08.480577 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ad00618f-1e49-42b2-9529-0fe1cd379f49 req-1bc21dc2-0c3e-444f-8d4d-b03559492ecc service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:08.481322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ad00618f-1e49-42b2-9529-0fe1cd379f49 req-1bc21dc2-0c3e-444f-8d4d-b03559492ecc service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:08.493456 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-ad00618f-1e49-42b2-9529-0fe1cd379f49 req-1bc21dc2-0c3e-444f-8d4d-b03559492ecc service nova] Creating event network-vif-plugged:ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d for instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 on hv-cinder-84159 May 12 17:23:08.500179 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-ad00618f-1e49-42b2-9529-0fe1cd379f49 req-1bc21dc2-0c3e-444f-8d4d-b03559492ecc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039836 May 12 17:23:08.501227 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 403/818] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:08.745566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:08.746795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:08.753467 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:08.753912 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:08.754858 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:08.755269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:08.921550 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:08.930569 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f230f53a-748a-4776-ae23-d3d967581bf2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.191467 May 12 17:23:08.931470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 416/819] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:08 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:08.935376 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:08.936594 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:08.948014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:08.948474 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:08.949256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:08.949691 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:09.152521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:09.160395 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-90e67515-faaa-4a98-b366-74fd3d209383 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.230567 May 12 17:23:09.171151 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 404/820] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:08 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:09.952089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:09.952697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:09.960025 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:09.960568 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:09.961414 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:09.961920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:10.101862 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:10.111011 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-757d019f-6102-42ca-9544-192013242d47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1368 microversion: 2.1 time: 0.167245 May 12 17:23:10.112404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 417/821] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:09 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:10.178015 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:10.179277 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:10.186013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:10.186499 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:10.187273 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:10.187713 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:10.325521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:10.332924 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2c3d1a24-34d8-449d-8bbc-ad71535b5a0a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.158823 May 12 17:23:10.333715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 405/822] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:10 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:11.127910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:11.128546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:11.135072 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:11.135520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:11.136277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:11.136761 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:11.264730 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:11.272477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0071d874-d11a-48e0-9f5a-35a33736ab62 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1558 microversion: 2.1 time: 0.147883 May 12 17:23:11.273039 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 418/823] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:11 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:11.289462 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:11.289984 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:11.296373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:11.296890 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:11.297654 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:11.298085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:11.351176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:11.351784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:11.357525 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:11.357992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:11.358761 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:11.359196 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:11.374439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9493e5b7-662b-4a05-a227-927008eac979 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089385 May 12 17:23:11.375049 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 406/824] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:23:11 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:11.486748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:11.494327 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-db0f138b-35be-44a6-8dfe-8e97d0e70d77 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.147707 May 12 17:23:11.495089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 419/825] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:11 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:12.355774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-92cb90f2-f4dc-4c9c-ab0e-a7251bae4968 req-3b0828b5-c880-4e9a-a962-73faf0a3dc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95312fe9-ef90-4c74-ba58-31abb0fdd309", "tag": "ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:12.364401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-92cb90f2-f4dc-4c9c-ab0e-a7251bae4968 req-3b0828b5-c880-4e9a-a962-73faf0a3dc6f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:12.364891 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-92cb90f2-f4dc-4c9c-ab0e-a7251bae4968 req-3b0828b5-c880-4e9a-a962-73faf0a3dc6f service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:12.377421 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-92cb90f2-f4dc-4c9c-ab0e-a7251bae4968 req-3b0828b5-c880-4e9a-a962-73faf0a3dc6f service nova] Creating event network-changed:ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d for instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 on hv-cinder-84159 May 12 17:23:12.382446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-92cb90f2-f4dc-4c9c-ab0e-a7251bae4968 req-3b0828b5-c880-4e9a-a962-73faf0a3dc6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031013 May 12 17:23:12.383340 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 407/826] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:12.517489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:12.518134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:12.525055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:12.525507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:12.526266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:12.526726 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:12.654153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:12.661349 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-607e8c36-d73d-4b96-8c29-e0cc1e56e484 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.147859 May 12 17:23:12.661913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 420/827] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:12 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:13.679818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:13.680483 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:13.686556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:13.687001 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:13.687748 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:13.688172 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:13.821530 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:13.828748 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6c8fc050-62b2-43c6-8155-546867a8cde1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.153663 May 12 17:23:13.829309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 408/828] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:13 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:14.846253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:14.846842 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:14.853171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:14.853626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:14.854387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:14.854856 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:14.997046 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:15.004881 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-78cf3e37-e397-4030-9b0b-b6fb9cc860aa tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.162650 May 12 17:23:15.006962 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 421/829] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:14 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:16.023686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:16.024283 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:16.030500 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:16.030894 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:16.031676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:16.032110 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:16.210249 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:16.217402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0605bb88-42c8-4b89-9160-b2d7bd11b988 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.198234 May 12 17:23:16.217976 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 409/830] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:16 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:17.234943 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:17.235665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:17.241880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:17.242327 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:17.243122 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:17.243557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:17.391138 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:17.401190 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c9753ffb-fdb7-4aba-8232-fd41c630f36c tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.170121 May 12 17:23:17.401769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 422/831] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:17 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:18.418742 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:18.419554 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:18.422701 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-4d6cfd4d-0208-4d37-90eb-611d5e15e3ee req-7e385b2b-da5f-4ec6-bbab-09a2ca929856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c547832-2add-4148-8b83-baf4e11d5f36", "name": "network-vif-plugged", "status": "completed", "tag": "aab0755a-1de0-423e-bdf8-9d264bcf1f30"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:18.426847 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:18.427473 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:18.429064 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:18.429700 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:18.432981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-4d6cfd4d-0208-4d37-90eb-611d5e15e3ee req-7e385b2b-da5f-4ec6-bbab-09a2ca929856 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:18.433447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-4d6cfd4d-0208-4d37-90eb-611d5e15e3ee req-7e385b2b-da5f-4ec6-bbab-09a2ca929856 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:18.452576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-4d6cfd4d-0208-4d37-90eb-611d5e15e3ee req-7e385b2b-da5f-4ec6-bbab-09a2ca929856 service nova] Creating event network-vif-plugged:aab0755a-1de0-423e-bdf8-9d264bcf1f30 for instance 2c547832-2add-4148-8b83-baf4e11d5f36 on hv-cinder-84159 May 12 17:23:18.458485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-4d6cfd4d-0208-4d37-90eb-611d5e15e3ee req-7e385b2b-da5f-4ec6-bbab-09a2ca929856 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039613 May 12 17:23:18.460176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 423/832] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:23:18.588037 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:18.595700 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-893844fb-37a0-4c8c-a909-b2b1b188395d tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.181481 May 12 17:23:18.596377 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 410/833] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:18 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:19.614722 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:19.616003 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:19.622185 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:19.622865 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:19.623634 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:19.624067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:19.768300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:19.778183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-339c0c81-7fb1-49ce-8539-bfb47aa50d86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1265 microversion: 2.1 time: 0.168459 May 12 17:23:19.778795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 424/834] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:19 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:20.795176 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:20.795782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:20.801751 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:20.802199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:20.802990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:20.803454 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:20.936307 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:20.943553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d55d3d24-7fdd-48b8-a5bc-f4ab9d6fa290 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1451 microversion: 2.1 time: 0.152261 May 12 17:23:20.944111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 411/835] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:20 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:20.960155 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:20.960765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:20.966984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:20.967439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:20.968201 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:20.968637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:21.094728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:21.101910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b71421ff-c4ff-4d93-9d40-a095ac3550c1 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1451 microversion: 2.1 time: 0.146000 May 12 17:23:21.102485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 425/836] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:20 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:23.129473 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-9896b068-0313-4d0c-bcae-dd7b58eef88d req-4d556ced-0fae-4a56-9e97-7482e2156717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c547832-2add-4148-8b83-baf4e11d5f36", "tag": "aab0755a-1de0-423e-bdf8-9d264bcf1f30"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:23.139348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9896b068-0313-4d0c-bcae-dd7b58eef88d req-4d556ced-0fae-4a56-9e97-7482e2156717 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:23.139786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9896b068-0313-4d0c-bcae-dd7b58eef88d req-4d556ced-0fae-4a56-9e97-7482e2156717 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:23.150569 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-9896b068-0313-4d0c-bcae-dd7b58eef88d req-4d556ced-0fae-4a56-9e97-7482e2156717 service nova] Creating event network-changed:aab0755a-1de0-423e-bdf8-9d264bcf1f30 for instance 2c547832-2add-4148-8b83-baf4e11d5f36 on hv-cinder-84159 May 12 17:23:23.155584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-9896b068-0313-4d0c-bcae-dd7b58eef88d req-4d556ced-0fae-4a56-9e97-7482e2156717 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030330 May 12 17:23:23.156170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 412/837] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:44.622697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-daaeb74f-eb99-4eb8-9334-c6137dfa3d18 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Action: 'create', calling method: .version_select at 0x7f78aebd2820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1701538815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTRcMjen+tf8bvbff2tLbX2e8gh7RP+T3FeM4EnM3UhHwA+ndElADsWaV9RwnNYiJx/bDffnetNkV7gQTe0hLZlx0jp4kQc+WDUGXycSQPScw1+6DDwMJRtgmgMHGGT5w=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:44.636725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-daaeb74f-eb99-4eb8-9334-c6137dfa3d18 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Getting quotas for project 0e381a22482e4cb5a714dd3392a19c27. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:23:44.640439 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-daaeb74f-eb99-4eb8-9334-c6137dfa3d18 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Getting quotas for user 4268a944e2d049f2b308e12cb628c008 and project 0e381a22482e4cb5a714dd3392a19c27. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:23:44.663339 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-daaeb74f-eb99-4eb8-9334-c6137dfa3d18 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044689 May 12 17:23:44.663931 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 426/838] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:23:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:44.713363 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1790920949", "imageRef": "fb1a439a-95ca-4b31-8306-bdf00a20d8ae", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1701538815", "networks": [{"uuid": "0d2b0c23-00fb-4a8f-9441-ba408404271d"}]}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:44.762081 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] validate_networks() for [('0d2b0c23-00fb-4a8f-9441-ba408404271d', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:23:45.114532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:23:45.114953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:23:45.115447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:23:45.115876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:23:45.116280 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:23:45.125505 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:45.125892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:45.126716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:45.127148 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:45.143331 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Getting quotas for project 0e381a22482e4cb5a714dd3392a19c27. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:23:45.147205 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Getting quotas for user 4268a944e2d049f2b308e12cb628c008 and project 0e381a22482e4cb5a714dd3392a19c27. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:23:45.157716 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:23:45.159966 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb1a439a-95ca-4b31-8306-bdf00a20d8ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:23:45.209057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a0d0a278-1c15-4439-8411-5efc5540ca78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500229 May 12 17:23:45.209699 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 413/839] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:23:45.219471 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-93158186-472f-4955-ba7c-44abad6ee02d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:45.220085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-93158186-472f-4955-ba7c-44abad6ee02d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:45.275024 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-93158186-472f-4955-ba7c-44abad6ee02d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:45.281384 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-93158186-472f-4955-ba7c-44abad6ee02d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1259 microversion: 2.1 time: 0.065840 May 12 17:23:45.282135 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 427/840] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:45 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:46.299834 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:46.301108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:46.310103 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:46.310593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:46.311380 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:46.311829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:46.379927 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:46.387933 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a05123f5-9393-4784-aa93-a4e8ad016e36 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1329 microversion: 2.1 time: 0.093013 May 12 17:23:46.388495 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 414/841] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:46 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:47.405465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:47.406221 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:47.413538 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:47.414087 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:47.414919 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:47.415350 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:47.547357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:47.554564 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0d876a1e-e1b2-450a-8be3-f96deb919b78 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.153486 May 12 17:23:47.555121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 428/842] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:47 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:48.481249 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:48.481824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:48.488389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:48.488840 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:48.489622 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:48.490062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:48.513835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3ffab7fd-8424-4922-b721-83bc011405bb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/ips" status: 200 len: 149 microversion: 2.1 time: 0.036351 May 12 17:23:48.514745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 415/843] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:23:48 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:48.574548 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:48.576068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:48.583706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:48.584768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:48.585594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:48.586030 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:48.731982 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:48.739895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-79d42b9f-0608-4563-b75f-ae3422ff902c tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.171044 May 12 17:23:48.741103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 429/844] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:48 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:49.757636 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:49.759154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:49.765358 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:49.765820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:49.766606 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:49.767036 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:49.911307 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2300e03e-7fa6-4564-b759-5c25e93f7b6f"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:49.914787 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:49.918725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:49.925920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b6717ab0-d5ae-4d56-be82-5f9aa21ff1cb tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.171998 May 12 17:23:49.926528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 416/845] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:49 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:49.929878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:49.930333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:49.931162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:49.931596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:50.944520 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:50.945858 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:50.954092 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:50.954926 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:50.955973 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:50.956489 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:51.092387 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:51.100804 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-cf9eb3a6-668c-49f8-af65-21d8f30df9b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.161137 May 12 17:23:51.101612 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 417/846] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:50 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:52.117621 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:52.118295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:52.125077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:52.125530 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:52.126348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:52.126823 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:52.265543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:52.273603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2c278326-3791-45fa-9644-78b9c47ef5f8 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.160484 May 12 17:23:52.274174 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 418/847] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:52 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:53.291088 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:53.291833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:53.299614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:53.300077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:53.300864 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:53.301318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:53.434400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:53.443106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ab16a2e5-9d44-46a4-bc9d-72bde3d37217 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.156408 May 12 17:23:53.444682 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 419/848] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:53 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:54.460425 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:54.461978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:54.469171 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:54.469947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:54.470974 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:54.471556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:54.605511 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:54.612879 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8b5b4883-b0b9-4c91-a989-035e6cce7413 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.156593 May 12 17:23:54.613441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 420/849] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:54 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:55.630132 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:55.631348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:55.637774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:55.638216 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:55.638995 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:55.639422 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:55.761351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:55.768424 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2d52a763-703d-41ed-92f6-066ef0b042fe tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.142162 May 12 17:23:55.768983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 421/850] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:55 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:23:56.785177 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:56.785857 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:56.792909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:56.800101 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:56.800561 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:56.801006 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:56.899124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8fe945b3-ace2-42e0-97f4-ea547d6037f3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.991475 May 12 17:23:56.900205 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 430/851] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:23:49 2022] POST /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments => generated 194 bytes in 6993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:23:57.042649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:57.049800 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a01830e2-257e-4aed-91c0-e2bd28c6c89d tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.268515 May 12 17:23:57.056141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 422/852] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:56 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:57.509749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-fcc0fa45-8e46-4c1d-ab72-456f3601e540 req-3e1c7039-4c88-4bca-ac83-1d38e0c46380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:23:57.536529 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-fcc0fa45-8e46-4c1d-ab72-456f3601e540 req-3e1c7039-4c88-4bca-ac83-1d38e0c46380 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:57.537144 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-fcc0fa45-8e46-4c1d-ab72-456f3601e540 req-3e1c7039-4c88-4bca-ac83-1d38e0c46380 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:57.570990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-fcc0fa45-8e46-4c1d-ab72-456f3601e540 req-3e1c7039-4c88-4bca-ac83-1d38e0c46380 service nova] Creating event network-changed:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:23:57.579542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-fcc0fa45-8e46-4c1d-ab72-456f3601e540 req-3e1c7039-4c88-4bca-ac83-1d38e0c46380 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112976 May 12 17:23:57.580310 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 431/853] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:23:58.067126 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:58.067743 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:58.074215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:58.074712 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:58.075500 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:58.075939 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:58.490722 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:58.497863 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4b659167-ac30-414f-8789-6c54bef0c53a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.434593 May 12 17:23:58.498437 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 423/854] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:58 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:23:59.515686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:23:59.516385 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:23:59.522318 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:59.522819 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:59.523577 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:23:59.524014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:23:59.654408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:23:59.661686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e92249f8-e8c4-46e3-ae52-173484a396fd tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.150587 May 12 17:23:59.662278 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 432/855] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:23:59 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:00.678829 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:00.679439 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:00.685652 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:00.686094 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:00.686882 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:00.687315 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:00.812124 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:00.820003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-95246814-4eb2-4c6c-a6d3-15864628a86a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.145059 May 12 17:24:00.820570 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 424/856] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:00 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:01.836901 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:01.837478 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:01.843698 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:01.844140 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:01.844884 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:01.845309 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:01.971986 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:01.979793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-123dd90a-d0e4-4fd8-9165-8faba891ff53 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.146821 May 12 17:24:01.980350 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 433/857] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:01 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:02.605695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-3a31b278-6583-4666-938a-300aaf23e1f3 req-68281d9f-e624-40a7-a65d-eb833cb10a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "name": "network-vif-plugged", "status": "completed", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:02.615035 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-3a31b278-6583-4666-938a-300aaf23e1f3 req-68281d9f-e624-40a7-a65d-eb833cb10a69 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:02.615474 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-3a31b278-6583-4666-938a-300aaf23e1f3 req-68281d9f-e624-40a7-a65d-eb833cb10a69 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:02.627353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-3a31b278-6583-4666-938a-300aaf23e1f3 req-68281d9f-e624-40a7-a65d-eb833cb10a69 service nova] Creating event network-vif-plugged:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:24:02.633171 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-3a31b278-6583-4666-938a-300aaf23e1f3 req-68281d9f-e624-40a7-a65d-eb833cb10a69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 May 12 17:24:02.633908 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 425/858] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:02.996096 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:02.996708 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:03.003415 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:03.003895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:03.004639 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:03.005070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:03.131259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:03.138733 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8eea7137-7e14-4092-99aa-7a56de6d6ed9 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.146444 May 12 17:24:03.139240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 434/859] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:02 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:04.155573 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:04.156192 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:04.162669 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:04.163118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:04.163883 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:04.164316 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:04.306131 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:04.315625 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1aa695ea-3de3-4dc3-b521-6fbc909f3df2 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1359 microversion: 2.1 time: 0.164264 May 12 17:24:04.316198 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 426/860] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:04 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:04.379840 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5f4e971c-0d62-4a11-9cc7-430e6b749f96 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: .version_select at 0x7f78aeb89ee0>, body: {"keypair": {"name": "tempest-keypair-760787277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9E87fkqsunL/Qoi4pjoCKcH0b85VMeDsL+yc+/bdGWBkTxUjVL20mZf51aNxP3h6HnN82Bp1KeO2hNjUJ4BJTSDSCWPcGZMCwqlyji8NxdbeQ3OQVAFAy9edR3aGByHw=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:04.394285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-5f4e971c-0d62-4a11-9cc7-430e6b749f96 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:24:04.397958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-5f4e971c-0d62-4a11-9cc7-430e6b749f96 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:24:04.417792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5f4e971c-0d62-4a11-9cc7-430e6b749f96 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.041716 May 12 17:24:04.418291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 435/861] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:24:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:05.332932 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:05.333545 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:05.340129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:05.340577 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:05.341344 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:05.341775 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:05.541424 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:05.548636 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4e00f3e9-2114-4315-a212-a0b04ecc8d4a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1550 microversion: 2.1 time: 0.219492 May 12 17:24:05.549198 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 427/862] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:05 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1550 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:05.565007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:05.565620 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:05.572601 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:05.573050 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:05.573838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:05.574272 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:05.710300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:05.718786 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-85de9cc4-4840-484a-a7b0-ff0cfdd4bfba tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1550 microversion: 2.1 time: 0.158130 May 12 17:24:05.719489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 436/863] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:05 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:05.734020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:05.737364 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:05.738115 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Searching by: {'deleted': False, 'project_id': '0e381a22482e4cb5a714dd3392a19c27'} {{(pid=117074) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 17:24:05.745135 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:05.745585 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:05.746388 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:05.746855 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:05.760410 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2048932343", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfb02df-5940-4251-8c77-308786c51833"}], "security_groups": [{"name": "tempest-securitygroup--1924290707"}], "key_name": "tempest-keypair-760787277", "user_data": "}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:05.837009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.multi_cell_list [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117074) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 17:24:05.857299 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] validate_networks() for [('fcfb02df-5940-4251-8c77-308786c51833', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:24:06.091841 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d9603fbe-c12d-4ad6-9803-a22920cd479e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.361349 May 12 17:24:06.092341 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 428/864] 10.222.0.23 () {58 vars in 1124 bytes} [Thu May 12 17:24:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:06.102547 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:06.103152 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:06.108971 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:06.109411 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:06.110173 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:06.110634 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:06.230910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:24:06.231327 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:24:06.231791 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:24:06.232191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:24:06.232594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:24:06.240009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:06.247777 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-34937882-3d0a-40eb-a18b-1b21bed7bf10 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1550 microversion: 2.1 time: 0.149412 May 12 17:24:06.248539 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 429/865] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:06 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:06.251670 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:06.252272 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:06.253077 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:06.253505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:06.271692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:24:06.276089 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:24:06.286937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:24:06.291647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:24:06.343456 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5a8e5c80-659f-421a-9354-dc9b688bf7ce tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.587831 May 12 17:24:06.344133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 437/866] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:24:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 17:24:06.354215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-df22cb72-09d0-4ce5-94a1-72071117ae43 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:06.355458 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-df22cb72-09d0-4ce5-94a1-72071117ae43 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:06.422784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-df22cb72-09d0-4ce5-94a1-72071117ae43 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:06.431888 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-df22cb72-09d0-4ce5-94a1-72071117ae43 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1241 microversion: 2.1 time: 0.081813 May 12 17:24:06.432942 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 430/867] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:06 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:07.450228 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:07.450878 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:07.456978 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:07.457662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:07.458461 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:07.458898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:07.527112 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:07.534361 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6d536abe-ac2c-49a7-8e8c-cae52ec2eb87 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1299 microversion: 2.1 time: 0.088555 May 12 17:24:07.534938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 438/868] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:07 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:07.828910 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1da35f29-5464-4c31-8b93-16f414157dc9"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:07.829961 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:07.836853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:07.837303 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:07.838163 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:07.838571 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:08.073642 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b8df33a4-772d-48d2-a4b6-043b06e03962 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248480 May 12 17:24:08.079442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 431/869] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:24:07 2022] POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:08.552020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:08.552644 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:08.559806 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:08.560256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:08.561012 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:08.561446 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:08.709893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:08.717388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-baf02153-f88d-4a60-9f36-1a0cd8f46b18 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.169263 May 12 17:24:08.717975 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 439/870] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:08 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:08.830066 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-c21dc012-b0c7-40cf-ae44-5390331d2c67 req-c6ab9f6b-0c9d-4b2f-815d-e76959de25c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886", "tag": "354ebe50-e716-40f5-b96e-c8f1230e40aa"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:08.850162 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-c21dc012-b0c7-40cf-ae44-5390331d2c67 req-c6ab9f6b-0c9d-4b2f-815d-e76959de25c6 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:08.850632 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-c21dc012-b0c7-40cf-ae44-5390331d2c67 req-c6ab9f6b-0c9d-4b2f-815d-e76959de25c6 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:08.862466 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-c21dc012-b0c7-40cf-ae44-5390331d2c67 req-c6ab9f6b-0c9d-4b2f-815d-e76959de25c6 service nova] Creating event network-changed:354ebe50-e716-40f5-b96e-c8f1230e40aa for instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 on hv-cinder-84159 May 12 17:24:08.872194 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-c21dc012-b0c7-40cf-ae44-5390331d2c67 req-c6ab9f6b-0c9d-4b2f-815d-e76959de25c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052441 May 12 17:24:08.873443 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 432/871] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:09.733014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:09.733618 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:09.739917 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:09.740365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:09.741117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:09.741548 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:09.867489 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:09.874750 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bec33ca7-2d0b-4bbd-9a93-73db5f0472fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.145634 May 12 17:24:09.875308 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 440/872] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:09 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:10.893098 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:10.893793 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:10.900451 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:10.900897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:10.901655 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:10.902085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:11.033114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:11.040810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-cce00330-2d6a-4eb0-ab0c-ec1c10970c47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.152397 May 12 17:24:11.041361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 433/873] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:10 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:12.057919 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:12.058544 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:12.064836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:12.065276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:12.066384 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:12.066839 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:12.190066 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:12.197282 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f6a1428f-664f-4f99-8777-413ebbf9e547 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.143222 May 12 17:24:12.197853 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 441/874] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:12 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:13.214052 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:13.214662 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:13.220989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:13.221434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:13.222190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:13.222646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:13.350773 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:13.358197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9012dc12-b0fc-4320-b311-bf7af8d97185 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.148018 May 12 17:24:13.358640 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 434/875] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:13 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:14.375705 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:14.376301 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:14.384200 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:14.384647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:14.385947 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:14.386376 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:14.533005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:14.540255 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-278dfab3-8cd5-4dc5-93f2-2ffd9ced9dd0 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.168548 May 12 17:24:14.541032 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 442/876] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:14 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:14.670552 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-a1a409f2-638a-4ec0-a254-9d2aab6520f8 req-5d2632f8-651e-4896-8389-5ae20d94769e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886", "name": "network-vif-plugged", "status": "completed", "tag": "354ebe50-e716-40f5-b96e-c8f1230e40aa"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:14.679390 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a1a409f2-638a-4ec0-a254-9d2aab6520f8 req-5d2632f8-651e-4896-8389-5ae20d94769e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:14.679890 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-a1a409f2-638a-4ec0-a254-9d2aab6520f8 req-5d2632f8-651e-4896-8389-5ae20d94769e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:14.690876 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-a1a409f2-638a-4ec0-a254-9d2aab6520f8 req-5d2632f8-651e-4896-8389-5ae20d94769e service nova] Creating event network-vif-plugged:354ebe50-e716-40f5-b96e-c8f1230e40aa for instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 on hv-cinder-84159 May 12 17:24:14.696433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-a1a409f2-638a-4ec0-a254-9d2aab6520f8 req-5d2632f8-651e-4896-8389-5ae20d94769e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029633 May 12 17:24:14.697020 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 435/877] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:15.557374 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:15.558115 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:15.564470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:15.564915 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:15.565674 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:15.566100 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:15.611400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:15.612109 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:15.618704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:15.619154 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:15.619920 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:15.620354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:15.695029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:15.702218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-653d057d-9ee0-4c00-be53-2b536799972f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1367 microversion: 2.1 time: 0.149291 May 12 17:24:15.702810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 443/878] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:15 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:15.748328 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:15.756730 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8951e9fd-7fb7-489d-b295-838df9b48086 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1596 microversion: 2.1 time: 0.148791 May 12 17:24:15.757293 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 436/879] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:15 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1596 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:16.718785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:16.719389 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:16.725789 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:16.726237 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:16.727020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:16.727450 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:16.870202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:16.878111 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-667f2b73-0cbb-4453-b761-2c63c760ed5d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1558 microversion: 2.1 time: 0.163039 May 12 17:24:16.879046 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 444/880] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:16 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:16.895241 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:16.895776 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:16.903113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:16.903651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:16.904493 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:16.905026 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:17.129078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ce73a658-f84b-43d3-8369-c67f0c4938cc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237846 May 12 17:24:17.129665 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 437/881] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:24:16 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:17.815158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-5faf89e8-f15a-453f-ac81-cf1116c49911 req-6707b2c4-80e6-4fda-bf7a-bdcad9e6d835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:17.826852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-5faf89e8-f15a-453f-ac81-cf1116c49911 req-6707b2c4-80e6-4fda-bf7a-bdcad9e6d835 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:17.829151 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-5faf89e8-f15a-453f-ac81-cf1116c49911 req-6707b2c4-80e6-4fda-bf7a-bdcad9e6d835 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:17.843852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-5faf89e8-f15a-453f-ac81-cf1116c49911 req-6707b2c4-80e6-4fda-bf7a-bdcad9e6d835 service nova] Creating event network-changed:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:24:17.850981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-5faf89e8-f15a-453f-ac81-cf1116c49911 req-6707b2c4-80e6-4fda-bf7a-bdcad9e6d835 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040267 May 12 17:24:17.852277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 445/882] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:18.200650 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-2e3c1a6e-6a3e-42e2-bafc-0afadb8ccca5 req-942d68fb-1036-4a30-9705-7024dfaf5cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886", "tag": "354ebe50-e716-40f5-b96e-c8f1230e40aa"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:18.212354 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2e3c1a6e-6a3e-42e2-bafc-0afadb8ccca5 req-942d68fb-1036-4a30-9705-7024dfaf5cde service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:18.213249 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2e3c1a6e-6a3e-42e2-bafc-0afadb8ccca5 req-942d68fb-1036-4a30-9705-7024dfaf5cde service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:18.236598 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-2e3c1a6e-6a3e-42e2-bafc-0afadb8ccca5 req-942d68fb-1036-4a30-9705-7024dfaf5cde service nova] Creating event network-changed:354ebe50-e716-40f5-b96e-c8f1230e40aa for instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 on hv-cinder-84159 May 12 17:24:18.252197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-2e3c1a6e-6a3e-42e2-bafc-0afadb8ccca5 req-942d68fb-1036-4a30-9705-7024dfaf5cde service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056164 May 12 17:24:18.253212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 438/883] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:19.156688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-278247068"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:19.157945 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:19.165477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:19.165919 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:19.166725 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:19.167161 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:19.313281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.network.security_group_api [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Adding security group c7f4352e-385f-4249-9f08-6cdadad5a070 to port 1a689752-651a-4853-a501-d55b4b71ffb2 May 12 17:24:19.698063 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-41816c47-f606-4723-bf61-05111a74a262 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/action" status: 202 len: 0 microversion: 2.1 time: 0.545532 May 12 17:24:19.705936 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 446/884] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:24:19 2022] POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:24:19.711487 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:19.712278 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:19.719979 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:19.720504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:19.721363 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:19.721870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:19.883534 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:19.893295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9046c4f5-2bf8-4c41-935a-3c100279a5b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1760 microversion: 2.1 time: 0.187956 May 12 17:24:19.893865 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 439/885] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:19 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:20.272007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-90a7681d-c49e-4f57-a3b5-e2e92bb81363 req-6b642c42-b2aa-461c-a6d9-fe7dbd24f2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:20.280689 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-90a7681d-c49e-4f57-a3b5-e2e92bb81363 req-6b642c42-b2aa-461c-a6d9-fe7dbd24f2da service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:20.281222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-90a7681d-c49e-4f57-a3b5-e2e92bb81363 req-6b642c42-b2aa-461c-a6d9-fe7dbd24f2da service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:20.292969 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-90a7681d-c49e-4f57-a3b5-e2e92bb81363 req-6b642c42-b2aa-461c-a6d9-fe7dbd24f2da service nova] Creating event network-changed:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:24:20.297980 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-90a7681d-c49e-4f57-a3b5-e2e92bb81363 req-6b642c42-b2aa-461c-a6d9-fe7dbd24f2da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030228 May 12 17:24:20.298783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 447/886] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:42.650641 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:42.651589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:42.657999 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:42.658482 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:42.659257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:42.659701 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:42.731031 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2298ef8d-3681-4339-8f74-3dde1120390a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/action" status: 202 len: 0 microversion: 2.1 time: 0.084631 May 12 17:24:42.731738 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 440/887] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:24:42 2022] POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:24:42.741246 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:42.741937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:42.748515 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:42.748964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:42.749774 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:42.750274 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:42.899005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:42.906893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9fdc65dc-9a39-4252-997f-b4a9428d518a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1752 microversion: 2.1 time: 0.170574 May 12 17:24:42.907396 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 448/888] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:42 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:43.925085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:43.925848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:43.932009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:43.932449 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:43.933195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:43.933623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:44.074130 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:44.082057 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b587acac-0836-4f9a-bb14-2c4faf588190 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.161566 May 12 17:24:44.082649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 441/889] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:43 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:45.099907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:45.100997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:45.107305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:45.107751 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:45.108504 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:45.108939 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:45.266236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:45.274860 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-7155a6fa-a402-4cec-8ba1-157313439315 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.178900 May 12 17:24:45.275452 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 449/890] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:45 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:46.291750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:46.292352 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:46.298782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:46.299224 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:46.299983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:46.300404 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:46.438068 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:46.446449 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-674621ef-3411-4748-b347-d4f6b586629e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.158611 May 12 17:24:46.447014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 442/891] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:46 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:47.464133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:47.464755 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:47.471019 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:47.471461 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:47.472213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:47.472643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:47.612290 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:47.620580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2065039f-6d04-44cf-8ff6-a37a2eb47ab0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.160926 May 12 17:24:47.621142 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 450/892] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:47 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:48.637904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:48.638531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:48.644898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:48.645346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:48.646108 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:48.646645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:48.790121 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:48.797941 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2060b627-d68c-4d4a-bfb7-91ae08a0a84f tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.164058 May 12 17:24:48.798523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 443/893] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:48 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:49.815031 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:49.815650 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:49.821828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:49.822267 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:49.823054 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:49.823479 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:49.962818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:49.970603 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-12fd7f97-a405-43a2-9bc5-0eef97bd1194 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.159375 May 12 17:24:49.971152 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 451/894] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:49 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:50.987978 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:50.988582 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:50.995335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:50.995775 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:50.996528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:50.996954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:51.134725 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:51.142509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-dc9fab6e-0c33-4c7e-85d2-0815c749767e tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.158306 May 12 17:24:51.143013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 444/895] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:50 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:52.159784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:52.160341 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:52.167269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:52.167723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:52.168485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:52.168921 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:52.311548 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:52.319284 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2832c3c7-fafc-4120-9e0f-1c4c64f62dd4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.163513 May 12 17:24:52.319847 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 452/896] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:52 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:53.252316 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:53.252846 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:53.263213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-48ff805b-271f-453f-a736-f41bbbc0a988 req-33a051c8-edb1-4eb8-879c-b4060c7e0963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c547832-2add-4148-8b83-baf4e11d5f36", "tag": "aab0755a-1de0-423e-bdf8-9d264bcf1f30"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:53.269085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.269575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.270309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.270767 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.271505 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-48ff805b-271f-453f-a736-f41bbbc0a988 req-33a051c8-edb1-4eb8-879c-b4060c7e0963 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.272532 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-48ff805b-271f-453f-a736-f41bbbc0a988 req-33a051c8-edb1-4eb8-879c-b4060c7e0963 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.289186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-48ff805b-271f-453f-a736-f41bbbc0a988 req-33a051c8-edb1-4eb8-879c-b4060c7e0963 service nova] Creating event network-changed:aab0755a-1de0-423e-bdf8-9d264bcf1f30 for instance 2c547832-2add-4148-8b83-baf4e11d5f36 on hv-cinder-84159 May 12 17:24:53.294542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-48ff805b-271f-453f-a736-f41bbbc0a988 req-33a051c8-edb1-4eb8-879c-b4060c7e0963 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034771 May 12 17:24:53.295729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 453/897] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:53.308768 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:24:53.339563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:53.340266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:53.348828 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.349336 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.350236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.350710 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.405745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-eb24cc16-7417-4b2f-a14a-9b1194961a48 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 204 len: 0 microversion: 2.1 time: 0.155175 May 12 17:24:53.408348 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 445/898] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:24:53 2022] DELETE /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:24:53.416199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:53.417695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:53.424080 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.424667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.425909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:53.426623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:53.521823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:53.530525 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-bfd04238-f05f-49ce-929e-387592ccd758 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.196893 May 12 17:24:53.531101 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 454/899] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:53 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:53.578624 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:53.586810 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bc6d32a7-9300-4b77-88a3-07894136bd86 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1576 microversion: 2.1 time: 0.176616 May 12 17:24:53.587380 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 446/900] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:53 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:54.547571 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:54.548176 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:54.555109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.555557 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.556314 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.556746 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.605235 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:54.605844 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:54.612526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.613054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.613928 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.614450 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.697469 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:54.705667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4b79aa2a-6f6b-4a84-8b6e-711b2fd7f729 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.161869 May 12 17:24:54.706464 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 455/901] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:54 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:54.711076 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:54.711575 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:54.717295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.717793 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.718597 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.719033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.747045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:54.747417 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-79f2b305-b1e1-483e-b211-bcca02869e36 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/ips" status: 200 len: 150 microversion: 2.1 time: 0.039830 May 12 17:24:54.750872 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 456/902] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:24:54 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:54.754788 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a7e2781b-7a8b-46a8-a387-10b26a82455e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1576 microversion: 2.1 time: 0.153332 May 12 17:24:54.755374 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 447/903] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:54 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:54.766498 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2300e03e-7fa6-4564-b759-5c25e93f7b6f"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:54.768103 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:54.774743 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.775169 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.775920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.776344 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.852408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Invalid volume: volume 2300e03e-7fa6-4564-b759-5c25e93f7b6f is already attached to instances: 95312fe9-ef90-4c74-ba58-31abb0fdd309 May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: POST /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/os-volume_attachments HTTP/1.1 May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 74 May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:24:54.854146 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {"volumeAttachment": {"volumeId": "2300e03e-7fa6-4564-b759-5c25e93f7b6f"}} May 12 17:24:54.855883 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Invalid volume: volume 2300e03e-7fa6-4564-b759-5c25e93f7b6f is already attached to instances: 95312fe9-ef90-4c74-ba58-31abb0fdd309 May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'server_id': '7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886', 'body': {'volumeAttachment': {'volumeId': '2300e03e-7fa6-4564-b759-5c25e93f7b6f'}}} May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2300e03e-7fa6-4564-b759-5c25e93f7b6f is already attached to instances: 95312fe9-ef90-4c74-ba58-31abb0fdd309 May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:54.857048 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2300e03e-7fa6-4564-b759-5c25e93f7b6f is already attached to instances: 95312fe9-ef90-4c74-ba58-31abb0fdd309 May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:54.858681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2300e03e-7fa6-4564-b759-5c25e93f7b6f is already attached to instances: 95312fe9-ef90-4c74-ba58-31abb0fdd309 May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 400 to user: Invalid volume: volume 2300e03e-7fa6-4564-b759-5c25e93f7b6f is already attached to instances: 95312fe9-ef90-4c74-ba58-31abb0fdd309 {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f56b7b0b-f93e-43d7-8ec0-90a083bf7de7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097107 May 12 17:24:54.860405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 457/904] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:24:54 2022] POST /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:24:54.864289 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:54.864791 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:54.871416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.871865 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.872635 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.873071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.897531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:24:54.970817 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5cf1d23c-2d92-457e-a98f-733dcd537f31 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 204 len: 0 microversion: 2.1 time: 0.110118 May 12 17:24:54.971397 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 448/905] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:24:54 2022] DELETE /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:24:54.980069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:54.980681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:54.986486 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.986934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:54.987713 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:54.988141 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:55.116548 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:55.123742 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a50552e0-e153-460d-be8c-ed05cef95e41 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1682 microversion: 2.1 time: 0.148190 May 12 17:24:55.124296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 458/906] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:54 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:55.723321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:55.723931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:55.730279 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:55.730769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:55.731532 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:55.731964 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:55.773110 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:55.773691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:55.780043 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:55.780482 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:55.781236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:55.781663 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:55.876132 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:55.884990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8d4b304a-f283-4bad-8b10-a9cc319f84db tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1757 microversion: 2.1 time: 0.165933 May 12 17:24:55.886029 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 449/907] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:55 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:55.912813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:55.920029 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0c09376a-2d6a-4352-a988-89dd83531abc tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1576 microversion: 2.1 time: 0.151466 May 12 17:24:55.920581 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 459/908] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:55 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:56.140990 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:56.141601 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:56.147553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:56.148000 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:56.148759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:56.149190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:56.275730 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:56.282969 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f18ee9bd-f1a9-4020-8863-c90997b149c2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1682 microversion: 2.1 time: 0.145830 May 12 17:24:56.283526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 450/909] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:56 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:56.901554 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:56.902163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:56.908613 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:56.909060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:56.909821 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:56.910257 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:56.937212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:56.937743 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:56.944268 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:56.944715 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:56.945469 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:56.945891 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:57.057573 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:57.065337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ca9f5752-1bbb-4f90-9c6c-913e28d2a587 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1760 microversion: 2.1 time: 0.167636 May 12 17:24:57.066085 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 460/910] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:56 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:57.085625 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:57.093082 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1c4b5ab6-3f32-4a5d-b368-562184913a97 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1576 microversion: 2.1 time: 0.159748 May 12 17:24:57.093642 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 451/911] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:56 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:24:57.300811 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:57.301885 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:57.310387 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:57.311090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:57.312120 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:57.312331 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:57.522688 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:57.530332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b1ba6433-0456-4beb-af57-337d403a4fba tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1682 microversion: 2.1 time: 0.233336 May 12 17:24:57.531366 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 461/912] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:57 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:57.822686 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-9b62a2f1-5e9a-4751-8590-100fd0f8e589 req-aa19b054-df2d-4f75-85e2-25cd5bacf74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c547832-2add-4148-8b83-baf4e11d5f36", "name": "network-vif-deleted", "tag": "aab0755a-1de0-423e-bdf8-9d264bcf1f30"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:57.832177 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9b62a2f1-5e9a-4751-8590-100fd0f8e589 req-aa19b054-df2d-4f75-85e2-25cd5bacf74b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:57.832670 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9b62a2f1-5e9a-4751-8590-100fd0f8e589 req-aa19b054-df2d-4f75-85e2-25cd5bacf74b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:57.845063 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-9b62a2f1-5e9a-4751-8590-100fd0f8e589 req-aa19b054-df2d-4f75-85e2-25cd5bacf74b service nova] Creating event network-vif-deleted:aab0755a-1de0-423e-bdf8-9d264bcf1f30 for instance 2c547832-2add-4148-8b83-baf4e11d5f36 on hv-cinder-84159 May 12 17:24:57.851875 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-9b62a2f1-5e9a-4751-8590-100fd0f8e589 req-aa19b054-df2d-4f75-85e2-25cd5bacf74b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 May 12 17:24:57.852482 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 452/913] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:58.112348 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:58.112958 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:58.122498 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.123249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.124495 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.125090 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.170855 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.171588 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.172227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lazy-loading 'fault' on Instance uuid 2c547832-2add-4148-8b83-baf4e11d5f36 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:24:58.216217 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-1a981f75-e2dc-43c6-8a0d-cfd852b37e8c req-c22b540e-ad29-45c7-8faf-48abf22eab0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886", "name": "network-vif-deleted", "tag": "354ebe50-e716-40f5-b96e-c8f1230e40aa"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:24:58.238391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-1a981f75-e2dc-43c6-8a0d-cfd852b37e8c req-c22b540e-ad29-45c7-8faf-48abf22eab0a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.241005 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-1a981f75-e2dc-43c6-8a0d-cfd852b37e8c req-c22b540e-ad29-45c7-8faf-48abf22eab0a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.255850 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:58.261315 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-1a981f75-e2dc-43c6-8a0d-cfd852b37e8c req-c22b540e-ad29-45c7-8faf-48abf22eab0a service nova] Creating event network-vif-deleted:354ebe50-e716-40f5-b96e-c8f1230e40aa for instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 on hv-cinder-84159 May 12 17:24:58.265625 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9d64f253-64d1-48a6-bf61-5783fef2fc62 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 200 len: 1230 microversion: 2.1 time: 0.157048 May 12 17:24:58.266810 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 462/914] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:58 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:58.269372 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-1a981f75-e2dc-43c6-8a0d-cfd852b37e8c req-c22b540e-ad29-45c7-8faf-48abf22eab0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066176 May 12 17:24:58.269975 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 453/915] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:24:58.547654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:58.548207 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:58.554616 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.555058 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.555811 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.556239 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.585096 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:58.585532 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:58.585971 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lazy-loading 'fault' on Instance uuid 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:24:58.626500 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:24:58.635352 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-42bc555b-1065-4caa-ba87-52f939f873cf tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 200 len: 1331 microversion: 2.1 time: 0.091777 May 12 17:24:58.641128 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 463/916] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:58 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:24:59.284323 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:59.285106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 2c547832-2add-4148-8b83-baf4e11d5f36] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:59.291924 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:59.292507 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:59.293349 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:59.293861 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:59.308535 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] HTTP exception thrown: Instance 2c547832-2add-4148-8b83-baf4e11d5f36 could not be found. May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Request method failure captured: May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 HTTP/1.1 May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUEjHvoLPOQmsvMzR3VsyfqN6V8UaCMsKRl9nWZZFoS9wt88B2RbKTIkiclyqupHCbV2H7tL_HKoKU2409-0O6Hym-J5-eNHf-Sf5b4KbjXgNjN65vpgMMjiqyL4UgQHXo1cUw33PFfPu5WTvPnVMv5I_vkO61R7EceYIr14DJsEqjA May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:24:59.310484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-TestVolumeBootPattern-580077577 May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-TestVolumeBootPattern-580077577-project May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 845032b55cfa40ad9fcd8b14782483d5 May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-TestVolumeBootPattern-580077577-project May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 2c547832-2add-4148-8b83-baf4e11d5f36 could not be found. May 12 17:24:59.312077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '2c547832-2add-4148-8b83-baf4e11d5f36'} May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c547832-2add-4148-8b83-baf4e11d5f36 could not be found. May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:24:59.313014 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c547832-2add-4148-8b83-baf4e11d5f36 could not be found. May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c547832-2add-4148-8b83-baf4e11d5f36 could not be found. May 12 17:24:59.314543 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:24:59.315909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Returning 404 to user: Instance 2c547832-2add-4148-8b83-baf4e11d5f36 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:24:59.315909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-62745f81-c20a-4d58-ac81-0eab044981a4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36" status: 404 len: 111 microversion: 2.1 time: 0.031959 May 12 17:24:59.315909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 454/917] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:59 2022] GET /compute/v2.1/servers/2c547832-2add-4148-8b83-baf4e11d5f36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:24:59.652459 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:59.653065 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:24:59.659323 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:59.659767 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:59.660522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:24:59.660953 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:24:59.673982 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 HTTP/1.1 May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:24:59.675507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:24:59.677109 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886'} May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:24:59.678732 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:24:59.680302 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:24:59.681686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:24:59.681686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5cc24850-013d-477a-8277-f77e56c76c7a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 404 len: 111 microversion: 2.1 time: 0.028242 May 12 17:24:59.681686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 464/918] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:24:59 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:24:59.686295 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-84d1cce7-6e24-485c-9169-44e3889960b6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '.version_select at 0x7f78af368e50>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:24:59.703262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-84d1cce7-6e24-485c-9169-44e3889960b6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760787277" status: 202 len: 0 microversion: 2.1 time: 0.020916 May 12 17:24:59.703802 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 455/919] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 12 17:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760787277 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:25:00.607429 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:00.607916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:00.613558 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:00.613998 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:00.614783 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:00.615211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:00.693372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lazy-loading 'services' on Instance uuid 95312fe9-ef90-4c74-ba58-31abb0fdd309 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:25:00.765780 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9e16f5f3-9866-40a5-aa5f-3133e7f7c0a7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments/2300e03e-7fa6-4564-b759-5c25e93f7b6f" status: 202 len: 0 microversion: 2.1 time: 0.162028 May 12 17:25:00.766363 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 465/920] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:25:00 2022] DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments/2300e03e-7fa6-4564-b759-5c25e93f7b6f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:25:00.776410 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:00.777332 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:00.784801 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:00.785355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:00.786175 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:00.786673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:00.827309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5efd73ab-e4a9-458b-aca3-13911c0e3004 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056398 May 12 17:25:00.827910 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 456/921] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:25:00 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:01.840166 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:01.841814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:01.847838 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:01.848285 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:01.849040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:01.849472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:01.882070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-944190da-87ad-4fa6-a3e3-1941ec7fbc8a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046619 May 12 17:25:01.882859 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 466/922] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:25:01 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:25:01.940229 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:01.940841 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:01.947375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:01.947862 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:01.948833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:01.949272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:01.982165 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:25:02.062084 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-81028c5f-a0ea-4072-b770-8275c11378fe tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 204 len: 0 microversion: 2.1 time: 0.125867 May 12 17:25:02.063109 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 457/923] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:25:01 2022] DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:25:02.072102 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:02.072711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:02.078473 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.078925 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.079685 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.080306 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.295752 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:02.303082 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5dd86953-05a2-4157-a26a-9c65c6df71fb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1682 microversion: 2.1 time: 0.235259 May 12 17:25:02.303637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 467/924] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:02 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:02.467233 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:02.467812 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:02.469512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-02720487-2c51-45b8-880d-e6ac9cd44a92 req-28b27a61-1dbf-44fe-84df-0b6ec3d9a503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a0e8b1-2d3c-4f5b-b6d9-a7039363047e", "tag": "0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:02.473725 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.474171 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.474968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.475401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.477555 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-02720487-2c51-45b8-880d-e6ac9cd44a92 req-28b27a61-1dbf-44fe-84df-0b6ec3d9a503 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.478219 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-02720487-2c51-45b8-880d-e6ac9cd44a92 req-28b27a61-1dbf-44fe-84df-0b6ec3d9a503 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.489364 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-02720487-2c51-45b8-880d-e6ac9cd44a92 req-28b27a61-1dbf-44fe-84df-0b6ec3d9a503 service nova] Creating event network-changed:0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba for instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e on hv-cinder-84159 May 12 17:25:02.495300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-02720487-2c51-45b8-880d-e6ac9cd44a92 req-28b27a61-1dbf-44fe-84df-0b6ec3d9a503 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029857 May 12 17:25:02.496415 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 468/925] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:02.500610 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:25:02.574649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-96738759-3b79-4b3c-a1a5-58dee11fabba tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 204 len: 0 microversion: 2.1 time: 0.111520 May 12 17:25:02.575220 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 458/926] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:25:02 2022] DELETE /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:25:02.583787 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:02.585121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:02.591119 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.591567 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.592335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:02.592762 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:02.725372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:02.732715 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4fd576e0-2932-4b76-bd46-a880964dbd5f tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1577 microversion: 2.1 time: 0.153046 May 12 17:25:02.733281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 469/927] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:02 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:25:03.320885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:03.321588 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:03.328355 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:03.328913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:03.329752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:03.330251 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:03.496122 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:03.505176 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-614a8dbd-9478-40c7-9f90-22b0cfbe7c24 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1682 microversion: 2.1 time: 0.188567 May 12 17:25:03.505820 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 459/928] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:03 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:03.751392 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:03.752002 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:03.758602 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:03.759049 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:03.759808 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:03.760241 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:03.886980 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:03.894230 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-a07ed32d-3a7e-4d74-871f-c7dee8e9d916 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1577 microversion: 2.1 time: 0.146647 May 12 17:25:03.894834 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 470/929] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:03 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:04.523157 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:04.523750 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:04.530060 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:04.530545 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:04.531328 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:04.531763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:04.655785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:04.663048 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e939915c-d76f-4272-950a-f060d3b461f2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1682 microversion: 2.1 time: 0.144456 May 12 17:25:04.663613 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 460/930] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:04 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:04.911955 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:04.913079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:04.919080 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:04.919529 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:04.920286 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:04.920716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:05.050043 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:05.057990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f2c006e5-5bf5-4838-b66e-b4a4a92cfd1a tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1577 microversion: 2.1 time: 0.150051 May 12 17:25:05.058567 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 471/931] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:04 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:05.681036 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:05.681648 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:05.688485 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:05.689361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:05.690294 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:05.690872 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:05.781511 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:05.789370 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6edec8dd-c4fa-4699-8b50-e46dd8362c25 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 200 len: 1614 microversion: 2.1 time: 0.112526 May 12 17:25:05.790236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 461/932] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:05 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:06.062705 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-bcae1813-4816-4bda-b242-f20503b35d66 req-95d12a85-c3c3-4a0a-b5ae-d162b4265ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95312fe9-ef90-4c74-ba58-31abb0fdd309", "name": "network-vif-deleted", "tag": "ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:06.075529 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:06.076963 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:06.087022 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:06.089706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-bcae1813-4816-4bda-b242-f20503b35d66 req-95d12a85-c3c3-4a0a-b5ae-d162b4265ded service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:06.090528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:06.091527 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:06.092213 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:06.097342 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-bcae1813-4816-4bda-b242-f20503b35d66 req-95d12a85-c3c3-4a0a-b5ae-d162b4265ded service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:06.117996 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-bcae1813-4816-4bda-b242-f20503b35d66 req-95d12a85-c3c3-4a0a-b5ae-d162b4265ded service nova] Creating event network-vif-deleted:ec62c0b9-df56-46e3-925d-ba0cc9cf0d6d for instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 on hv-cinder-84159 May 12 17:25:06.148015 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-bcae1813-4816-4bda-b242-f20503b35d66 req-95d12a85-c3c3-4a0a-b5ae-d162b4265ded service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089283 May 12 17:25:06.151579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 472/933] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:25:06.156853 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-97b6b956-bb39-41e8-ba7c-613ca4700c6e req-97b8b4d5-12ec-445a-9536-59f7309e92c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a0e8b1-2d3c-4f5b-b6d9-a7039363047e", "name": "network-vif-deleted", "tag": "0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:06.172778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-97b6b956-bb39-41e8-ba7c-613ca4700c6e req-97b8b4d5-12ec-445a-9536-59f7309e92c8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:06.173215 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-97b6b956-bb39-41e8-ba7c-613ca4700c6e req-97b8b4d5-12ec-445a-9536-59f7309e92c8 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:06.187710 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845032b55cfa40ad9fcd8b14782483d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d002d9e79b24742b0906bc2b220d998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:06.195937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-97b6b956-bb39-41e8-ba7c-613ca4700c6e req-97b8b4d5-12ec-445a-9536-59f7309e92c8 service nova] Creating event network-vif-deleted:0f9ed0e2-fdf3-439b-a2fd-41bd3abe42ba for instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e on hv-cinder-84159 May 12 17:25:06.196830 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-00b0fdb7-a21a-4aa7-ab3f-dd0f9f7c0e71 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 200 len: 1391 microversion: 2.1 time: 0.125103 May 12 17:25:06.197484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 462/934] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:06 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 1391 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:25:06.215670 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-97b6b956-bb39-41e8-ba7c-613ca4700c6e req-97b8b4d5-12ec-445a-9536-59f7309e92c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062612 May 12 17:25:06.216273 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 473/935] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:06.807400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:06.808419 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:06.817042 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:06.817496 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:06.818556 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:06.819654 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:06.834309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 HTTP/1.1 May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:25:06.836013 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:25:06.837428 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '95312fe9-ef90-4c74-ba58-31abb0fdd309'} May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:25:06.838208 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:25:06.839913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:06.842159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:25:06.842159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-cb5fd072-f923-45f9-9687-e4bd7b272984 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 404 len: 111 microversion: 2.1 time: 0.034911 May 12 17:25:06.842159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 463/936] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:06 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:25:06.848044 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-850a08ec-a381-4bf7-a129-fc023ad4ad47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '.version_select at 0x7f78aeb64ee0>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:06.872846 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-850a08ec-a381-4bf7-a129-fc023ad4ad47 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085778224" status: 202 len: 0 microversion: 2.1 time: 0.028917 May 12 17:25:06.873435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 474/937] 10.222.0.23 () {58 vars in 1220 bytes} [Thu May 12 17:25:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085778224 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:25:07.213113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:07.213972 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:07.220151 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:07.220808 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:07.221988 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:07.222540 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:07.239041 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] HTTP exception thrown: Instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e could not be found. May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Request method failure captured: May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e HTTP/1.1 May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUEjHvoLPOQmsvMzR3VsyfqN6V8UaCMsKRl9nWZZFoS9wt88B2RbKTIkiclyqupHCbV2H7tL_HKoKU2409-0O6Hym-J5-eNHf-Sf5b4KbjXgNjN65vpgMMjiqyL4UgQHXo1cUw33PFfPu5WTvPnVMv5I_vkO61R7EceYIr14DJsEqjA May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:25:07.241461 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-TestVolumeBootPattern-580077577-project May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 845032b55cfa40ad9fcd8b14782483d5 May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-TestVolumeBootPattern-580077577-project May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e could not be found. May 12 17:25:07.243212 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '50a0e8b1-2d3c-4f5b-b6d9-a7039363047e'} May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e could not be found. May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:25:07.244043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e could not be found. May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e could not be found. May 12 17:25:07.245947 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.248510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Returning 404 to user: Instance 50a0e8b1-2d3c-4f5b-b6d9-a7039363047e could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:25:07.248510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-197e5c2a-0d33-4563-ac60-1c560a456c5b tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e" status: 404 len: 111 microversion: 2.1 time: 0.034821 May 12 17:25:07.248510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 464/938] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:07 2022] GET /compute/v2.1/servers/50a0e8b1-2d3c-4f5b-b6d9-a7039363047e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:25:07.547855 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d0935f3a-db16-4676-80fe-42061c1ca0d9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: .version_select at 0x7f78aeb2af70>, body: {"keypair": {"name": "tempest-keypair-963410469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ76frVJPxGpFQKa8Z5KNVEpP8dU42MXhBOUZ8EZJ0GO+difn/6il8z685YDZtVe8XIJlzg8rpG+f4F+UElt6Zs1Jw71Qo2xdU/KnmSGmShWYBBbaIURCJ5B5ntq2daYGg=="}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:07.562702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-d0935f3a-db16-4676-80fe-42061c1ca0d9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:25:07.566444 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-d0935f3a-db16-4676-80fe-42061c1ca0d9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:25:07.588060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d0935f3a-db16-4676-80fe-42061c1ca0d9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046263 May 12 17:25:07.588896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 475/939] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:25:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:07.690635 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:07.691140 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:07.697118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:07.697566 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:07.698340 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:07.698803 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:07.712514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] HTTP exception thrown: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Request method failure captured: May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: DELETE /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d HTTP/1.1 May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUEjHvoLPOQmsvMzR3VsyfqN6V8UaCMsKRl9nWZZFoS9wt88B2RbKTIkiclyqupHCbV2H7tL_HKoKU2409-0O6Hym-J5-eNHf-Sf5b4KbjXgNjN65vpgMMjiqyL4UgQHXo1cUw33PFfPu5WTvPnVMv5I_vkO61R7EceYIr14DJsEqjA May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:25:07.714067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-TestVolumeBootPattern-580077577-project May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 845032b55cfa40ad9fcd8b14782483d5 May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-TestVolumeBootPattern-580077577-project May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.715687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '9131b16e-e337-480c-a45b-91625a94863d'} May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:25:07.716444 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.717695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:25:07.719158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Returning 404 to user: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:25:07.719158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3508a40f-bf5b-4704-8cbe-156e019b3020 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 404 len: 111 microversion: 2.1 time: 0.028823 May 12 17:25:07.719158 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 465/940] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:25:07 2022] DELETE /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:25:07.725522 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:07.726280 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] [instance: 9131b16e-e337-480c-a45b-91625a94863d] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:07.732357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:07.733007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:07.733824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:07.734357 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:07.749711 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] HTTP exception thrown: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Request method failure captured: May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d HTTP/1.1 May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUEjHvoLPOQmsvMzR3VsyfqN6V8UaCMsKRl9nWZZFoS9wt88B2RbKTIkiclyqupHCbV2H7tL_HKoKU2409-0O6Hym-J5-eNHf-Sf5b4KbjXgNjN65vpgMMjiqyL4UgQHXo1cUw33PFfPu5WTvPnVMv5I_vkO61R7EceYIr14DJsEqjA May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:25:07.751451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d002d9e79b24742b0906bc2b220d998"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 5d002d9e79b24742b0906bc2b220d998 May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-TestVolumeBootPattern-580077577 May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-TestVolumeBootPattern-580077577-project May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 845032b55cfa40ad9fcd8b14782483d5 May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-TestVolumeBootPattern-580077577-project May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.752979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '9131b16e-e337-480c-a45b-91625a94863d'} May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:25:07.754312 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. May 12 17:25:07.755894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:07.757934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Returning 404 to user: Instance 9131b16e-e337-480c-a45b-91625a94863d could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:25:07.757934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-236d1aac-3f95-4a5e-a78d-8607044cecc4 tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d" status: 404 len: 111 microversion: 2.1 time: 0.032122 May 12 17:25:07.757934 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 476/941] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:07 2022] GET /compute/v2.1/servers/9131b16e-e337-480c-a45b-91625a94863d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:25:08.817359 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2115770887", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfb02df-5940-4251-8c77-308786c51833"}], "security_groups": [{"name": "tempest-securitygroup--823141636"}], "key_name": "tempest-keypair-963410469", "user_data": "}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:08.975385 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] validate_networks() for [('fcfb02df-5940-4251-8c77-308786c51833', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:25:09.198329 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-19782463-b5b0-4f2b-bdc0-cf968466459e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] Calling method '.version_select at 0x7f78aed96670>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:09.216208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-19782463-b5b0-4f2b-bdc0-cf968466459e tempest-TestVolumeBootPattern-580077577 tempest-TestVolumeBootPattern-580077577-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1239243642" status: 202 len: 0 microversion: 2.1 time: 0.022079 May 12 17:25:09.217354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 477/942] 10.222.0.23 () {58 vars in 1262 bytes} [Thu May 12 17:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1239243642 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:25:09.404200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:25:09.404618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:25:09.405087 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:25:09.405490 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:25:09.405897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:25:09.415134 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:09.415581 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:09.416409 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:09.416844 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:09.433592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:25:09.437466 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:25:09.448692 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:25:09.451011 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:25:09.503038 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a916efc1-fe1b-4315-becb-cfc37555b4b5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689792 May 12 17:25:09.503867 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 466/943] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:25:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:25:09.514005 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-fac1084b-3785-4174-a720-20b92735c4e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:09.514650 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-fac1084b-3785-4174-a720-20b92735c4e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:09.733059 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-fac1084b-3785-4174-a720-20b92735c4e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:09.739900 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-fac1084b-3785-4174-a720-20b92735c4e9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1241 microversion: 2.1 time: 0.229615 May 12 17:25:09.750739 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 478/944] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:09 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:10.759377 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:10.760007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:10.766458 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:10.766923 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:10.767706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:10.768141 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:10.836176 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:10.843538 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7a43964f-a770-4249-9250-69992491c766 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1299 microversion: 2.1 time: 0.089607 May 12 17:25:10.844442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 467/945] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:10 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:11.860425 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:11.861748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:11.871818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:11.872579 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:11.873561 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:11.874064 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:11.973332 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-cf79bb64-daaa-46c7-9e87-f1fad4d41739 req-ac3f33f0-5ccc-428a-8923-9eda3de71ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5", "tag": "2fefabba-33b7-41b1-80f2-e0d24d8c847e"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:11.988149 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-cf79bb64-daaa-46c7-9e87-f1fad4d41739 req-ac3f33f0-5ccc-428a-8923-9eda3de71ea0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:11.988591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-cf79bb64-daaa-46c7-9e87-f1fad4d41739 req-ac3f33f0-5ccc-428a-8923-9eda3de71ea0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:12.004903 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-cf79bb64-daaa-46c7-9e87-f1fad4d41739 req-ac3f33f0-5ccc-428a-8923-9eda3de71ea0 service nova] Creating event network-changed:2fefabba-33b7-41b1-80f2-e0d24d8c847e for instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 on hv-cinder-84159 May 12 17:25:12.011659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-cf79bb64-daaa-46c7-9e87-f1fad4d41739 req-ac3f33f0-5ccc-428a-8923-9eda3de71ea0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041905 May 12 17:25:12.012484 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 468/946] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:12.125314 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:12.135992 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-fd6727c0-ad60-4ee8-b003-43e05e24069c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1366 microversion: 2.1 time: 0.279510 May 12 17:25:12.137214 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 479/947] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:11 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:13.154575 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:13.155287 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:13.161743 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:13.162230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:13.163611 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:13.164055 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:13.394206 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:13.402003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7c54d633-7cc8-44ab-9005-d071c30e3c5e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1366 microversion: 2.1 time: 0.252144 May 12 17:25:13.402657 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 469/948] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:13 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:14.418488 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:14.419296 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:14.425744 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:14.426300 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:14.427105 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:14.427705 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:14.572563 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:14.582056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-86c33160-3950-465b-a197-4d05d3c7d15c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1366 microversion: 2.1 time: 0.167618 May 12 17:25:14.582722 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 480/949] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:14 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:15.599893 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:15.600806 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:15.607811 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:15.609521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:15.610447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:15.610954 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:15.767313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:15.782226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1a603508-47d7-4093-85af-01d017737c57 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1366 microversion: 2.1 time: 0.186997 May 12 17:25:15.783219 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 470/950] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:15 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:16.799740 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:16.800549 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:16.809365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:16.809365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:16.809365 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:16.809731 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:16.954605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:16.962814 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-97adfd85-ec63-4c9f-9b22-f2841b9b7038 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1366 microversion: 2.1 time: 0.166577 May 12 17:25:16.964053 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 481/951] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:16 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:17.058593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-79768c6b-4f17-4aaf-9c02-8e7152fcea5f req-f65d776e-97a2-4d38-8388-96673729e229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5", "name": "network-vif-plugged", "status": "completed", "tag": "2fefabba-33b7-41b1-80f2-e0d24d8c847e"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:17.087945 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-79768c6b-4f17-4aaf-9c02-8e7152fcea5f req-f65d776e-97a2-4d38-8388-96673729e229 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:17.089305 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-79768c6b-4f17-4aaf-9c02-8e7152fcea5f req-f65d776e-97a2-4d38-8388-96673729e229 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:17.108632 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-79768c6b-4f17-4aaf-9c02-8e7152fcea5f req-f65d776e-97a2-4d38-8388-96673729e229 service nova] Creating event network-vif-plugged:2fefabba-33b7-41b1-80f2-e0d24d8c847e for instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 on hv-cinder-84159 May 12 17:25:17.116875 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-79768c6b-4f17-4aaf-9c02-8e7152fcea5f req-f65d776e-97a2-4d38-8388-96673729e229 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061462 May 12 17:25:17.117938 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 471/952] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:17.981123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:17.981749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:17.987994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:17.988435 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:17.989177 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:17.989606 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:18.117679 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:18.124893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ee95edbb-7709-47cb-81d1-a3c1749f97d2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1366 microversion: 2.1 time: 0.147579 May 12 17:25:18.125447 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 482/953] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:17 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:19.143272 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:19.143898 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:19.151306 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:19.151759 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:19.152550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:19.152988 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:19.281667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:19.288930 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-23c1343a-27d8-48a7-b441-ee86326cb28d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1557 microversion: 2.1 time: 0.149952 May 12 17:25:19.289510 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 472/954] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:19 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:19.304937 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:19.305472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:19.311651 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:19.312094 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:19.312845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:19.313275 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:19.387510 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-589ba818-1025-42ef-81f1-dfa7a1c99f01 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086337 May 12 17:25:19.388099 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 483/955] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:25:19 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:20.319514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-f135a6a9-7634-4b98-8469-d9739eeae94a req-16962f80-90ec-4e78-8346-d48aefd13bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5", "tag": "2fefabba-33b7-41b1-80f2-e0d24d8c847e"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:20.327321 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f135a6a9-7634-4b98-8469-d9739eeae94a req-16962f80-90ec-4e78-8346-d48aefd13bc0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:20.327763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f135a6a9-7634-4b98-8469-d9739eeae94a req-16962f80-90ec-4e78-8346-d48aefd13bc0 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:20.338958 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-f135a6a9-7634-4b98-8469-d9739eeae94a req-16962f80-90ec-4e78-8346-d48aefd13bc0 service nova] Creating event network-changed:2fefabba-33b7-41b1-80f2-e0d24d8c847e for instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 on hv-cinder-84159 May 12 17:25:20.343856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-f135a6a9-7634-4b98-8469-d9739eeae94a req-16962f80-90ec-4e78-8346-d48aefd13bc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028317 May 12 17:25:20.344516 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 473/956] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:25:30.609470 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-278247068"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:30.610049 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:30.616542 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:30.616979 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:30.617723 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:30.618150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:30.742471 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.network.security_group_api [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Removing security group c7f4352e-385f-4249-9f08-6cdadad5a070 from port 1a689752-651a-4853-a501-d55b4b71ffb2 May 12 17:25:31.110768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-df33fddc-b583-47e9-9f35-01a7d527a0b1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/action" status: 202 len: 0 microversion: 2.1 time: 0.505613 May 12 17:25:31.112133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 484/957] 10.222.0.23 () {60 vars in 1277 bytes} [Thu May 12 17:25:30 2022] POST /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:25:31.122842 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-becb8f75-e4ab-4137-9568-10d29e46eec7 req-a0f2f2ed-7398-492c-abb2-8ac822ebd3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:31.135951 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-becb8f75-e4ab-4137-9568-10d29e46eec7 req-a0f2f2ed-7398-492c-abb2-8ac822ebd3ae service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:31.136610 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-becb8f75-e4ab-4137-9568-10d29e46eec7 req-a0f2f2ed-7398-492c-abb2-8ac822ebd3ae service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:31.153239 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-becb8f75-e4ab-4137-9568-10d29e46eec7 req-a0f2f2ed-7398-492c-abb2-8ac822ebd3ae service nova] Creating event network-changed:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:25:31.159407 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-becb8f75-e4ab-4137-9568-10d29e46eec7 req-a0f2f2ed-7398-492c-abb2-8ac822ebd3ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042319 May 12 17:25:31.160897 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 474/958] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:32.825668 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:32.826183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:32.832225 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:32.832665 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:32.833426 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:32.833854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:32.916362 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lazy-loading 'services' on Instance uuid 37146593-4785-4175-ba4d-9ffd1618a210 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:25:32.986788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9a58bbf5-1fc2-4966-96f3-02c157356be5 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments/1da35f29-5464-4c31-8b93-16f414157dc9" status: 202 len: 0 microversion: 2.1 time: 0.165340 May 12 17:25:32.987581 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 485/959] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:25:32 2022] DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments/1da35f29-5464-4c31-8b93-16f414157dc9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:25:32.997191 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:32.998205 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:33.005638 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:33.006749 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:33.008045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:33.008550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:33.040783 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e0f9eb19-341e-4d96-ab99-9e52b854e3ce tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048022 May 12 17:25:33.041351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 475/960] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:25:32 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:33.174666 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-63486db5-05c9-4c25-ba1b-2c401cd5aa37 req-ca40f71b-d93c-4841-9a26-fb0b873e9db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:33.183162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-63486db5-05c9-4c25-ba1b-2c401cd5aa37 req-ca40f71b-d93c-4841-9a26-fb0b873e9db9 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:33.183596 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-63486db5-05c9-4c25-ba1b-2c401cd5aa37 req-ca40f71b-d93c-4841-9a26-fb0b873e9db9 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:33.197060 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-63486db5-05c9-4c25-ba1b-2c401cd5aa37 req-ca40f71b-d93c-4841-9a26-fb0b873e9db9 service nova] Creating event network-changed:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:25:33.202018 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-63486db5-05c9-4c25-ba1b-2c401cd5aa37 req-ca40f71b-d93c-4841-9a26-fb0b873e9db9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031351 May 12 17:25:33.202637 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 486/961] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:25:34.052658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:34.053607 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:34.059911 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:34.060360 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:34.061125 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:34.061555 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:34.088824 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-e638e5ea-b89b-4222-8349-451f56e6e83a tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040160 May 12 17:25:34.089368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 476/962] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:25:34 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:25:34.100848 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:34.101423 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:34.107450 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:34.107895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:34.108647 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:34.109079 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:34.179896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] HTTP exception thrown: Instance 37146593-4785-4175-ba4d-9ffd1618a210 is not attached to volume 1da35f29-5464-4c31-8b93-16f414157dc9 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Request method failure captured: May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments/1da35f29-5464-4c31-8b93-16f414157dc9 HTTP/1.1 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUKSzINBeguTojKNp5cF5bJE6R9BdUG2xeazh7wvxdFvWCWGy8UnZ_A3Vn0iTP73Lq8Ef7X86HpYiaBdh-q7DgpOvuv18VcoKS6v-ai4DDPYoYISE1Dn_E8dMix7isA-Y98iLM9tNsocG-pvlqb--D3mjgA7opg3xUBOfagiwrxy-zs May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 0e381a22482e4cb5a714dd3392a19c27 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-TestMinimumBasicScenario-1493335157 May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:25:34.182295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-TestMinimumBasicScenario-1493335157 May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 0e381a22482e4cb5a714dd3392a19c27 May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1493335157 May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-TestMinimumBasicScenario-1493335157-project May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 4268a944e2d049f2b308e12cb628c008 May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-TestMinimumBasicScenario-1493335157-project May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:25:34.184134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 37146593-4785-4175-ba4d-9ffd1618a210 is not attached to volume 1da35f29-5464-4c31-8b93-16f414157dc9 May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'server_id': '37146593-4785-4175-ba4d-9ffd1618a210', 'id': '1da35f29-5464-4c31-8b93-16f414157dc9'} May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1da35f29-5464-4c31-8b93-16f414157dc9. May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:25:34.185117 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37146593-4785-4175-ba4d-9ffd1618a210 is not attached to volume 1da35f29-5464-4c31-8b93-16f414157dc9 May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37146593-4785-4175-ba4d-9ffd1618a210 is not attached to volume 1da35f29-5464-4c31-8b93-16f414157dc9 May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:34.186692 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Returning 404 to user: Instance 37146593-4785-4175-ba4d-9ffd1618a210 is not attached to volume 1da35f29-5464-4c31-8b93-16f414157dc9 {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:25:34.187940 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4a13d935-2243-4050-b7ef-6ddabf8914c1 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments/1da35f29-5464-4c31-8b93-16f414157dc9" status: 404 len: 154 microversion: 2.1 time: 0.088380 May 12 17:25:34.187940 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 487/963] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:25:34 2022] DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210/os-volume_attachments/1da35f29-5464-4c31-8b93-16f414157dc9 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:25:35.312410 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:35.312884 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:35.319832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:35.320276 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:35.321035 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:35.321465 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:35.344996 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:25:35.415860 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f1ab281b-d34d-40a4-b242-ba00cc5ad3e4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 204 len: 0 microversion: 2.1 time: 0.106759 May 12 17:25:35.416747 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 477/964] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:25:35 2022] DELETE /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:25:35.425609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:35.426217 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:35.432769 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:35.433211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:35.433965 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:35.434401 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:35.559025 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:35.566171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f83d7edf-f3e8-4df7-b8e9-8f8a8d9eaa52 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1556 microversion: 2.1 time: 0.144402 May 12 17:25:35.566762 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 488/965] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:35 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1556 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:36.584513 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:36.585205 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:36.591514 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:36.591956 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:36.592706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:36.593133 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:36.718881 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:36.732956 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2f1143b5-e853-4e91-b6f5-4b919d5a0786 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1556 microversion: 2.1 time: 0.152615 May 12 17:25:36.733531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 478/966] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:36 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:37.750337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:37.750994 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:37.757372 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:37.757826 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:37.758626 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:37.759318 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:37.825046 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4268a944e2d049f2b308e12cb628c008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e381a22482e4cb5a714dd3392a19c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:25:37.832796 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-af70b268-90a2-40bc-85de-79c77bac43bf tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 200 len: 1514 microversion: 2.1 time: 0.086238 May 12 17:25:37.834456 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 489/967] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:37 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 1514 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:25:37.893989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-f8a1e393-29c1-49f9-ba9f-f1e5ad703cd9 req-796749f6-adab-46d8-b235-0d19b201d03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37146593-4785-4175-ba4d-9ffd1618a210", "name": "network-vif-deleted", "tag": "1a689752-651a-4853-a501-d55b4b71ffb2"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:37.902856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f8a1e393-29c1-49f9-ba9f-f1e5ad703cd9 req-796749f6-adab-46d8-b235-0d19b201d03b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:37.903309 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-f8a1e393-29c1-49f9-ba9f-f1e5ad703cd9 req-796749f6-adab-46d8-b235-0d19b201d03b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:37.914709 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-f8a1e393-29c1-49f9-ba9f-f1e5ad703cd9 req-796749f6-adab-46d8-b235-0d19b201d03b service nova] Creating event network-vif-deleted:1a689752-651a-4853-a501-d55b4b71ffb2 for instance 37146593-4785-4175-ba4d-9ffd1618a210 on hv-cinder-84159 May 12 17:25:37.919469 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-f8a1e393-29c1-49f9-ba9f-f1e5ad703cd9 req-796749f6-adab-46d8-b235-0d19b201d03b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029103 May 12 17:25:37.920061 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 479/968] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:38.850763 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:38.851369 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] [instance: 37146593-4785-4175-ba4d-9ffd1618a210] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:38.857594 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:38.858040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:38.858832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:38.859267 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:38.873038 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] HTTP exception thrown: Instance 37146593-4785-4175-ba4d-9ffd1618a210 could not be found. May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Request method failure captured: May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 HTTP/1.1 May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUKSzINBeguTojKNp5cF5bJE6R9BdUG2xeazh7wvxdFvWCWGy8UnZ_A3Vn0iTP73Lq8Ef7X86HpYiaBdh-q7DgpOvuv18VcoKS6v-ai4DDPYoYISE1Dn_E8dMix7isA-Y98iLM9tNsocG-pvlqb--D3mjgA7opg3xUBOfagiwrxy-zs May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: 0e381a22482e4cb5a714dd3392a19c27 May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-TestMinimumBasicScenario-1493335157 May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:25:38.874576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0e381a22482e4cb5a714dd3392a19c27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-TestMinimumBasicScenario-1493335157 May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: 0e381a22482e4cb5a714dd3392a19c27 May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1493335157 May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-TestMinimumBasicScenario-1493335157-project May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 4268a944e2d049f2b308e12cb628c008 May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-TestMinimumBasicScenario-1493335157-project May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 37146593-4785-4175-ba4d-9ffd1618a210 could not be found. May 12 17:25:38.876277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '37146593-4785-4175-ba4d-9ffd1618a210'} May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37146593-4785-4175-ba4d-9ffd1618a210 could not be found. May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:25:38.877393 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37146593-4785-4175-ba4d-9ffd1618a210 could not be found. May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37146593-4785-4175-ba4d-9ffd1618a210 could not be found. May 12 17:25:38.878942 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:25:38.880520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Returning 404 to user: Instance 37146593-4785-4175-ba4d-9ffd1618a210 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:25:38.880520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c17c23cd-7020-4af9-b917-2c76d19c84b0 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210" status: 404 len: 111 microversion: 2.1 time: 0.029570 May 12 17:25:38.880520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 490/969] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:25:38 2022] GET /compute/v2.1/servers/37146593-4785-4175-ba4d-9ffd1618a210 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:25:38.886261 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-4d2ea7cc-0755-49d4-a582-5b55e23616d4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] Calling method '.version_select at 0x7f78af5003a0>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:38.903120 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-4d2ea7cc-0755-49d4-a582-5b55e23616d4 tempest-TestMinimumBasicScenario-1493335157 tempest-TestMinimumBasicScenario-1493335157-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1701538815" status: 202 len: 0 microversion: 2.1 time: 0.021522 May 12 17:25:38.903690 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 480/970] 10.222.0.23 () {58 vars in 1271 bytes} [Thu May 12 17:25:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1701538815 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:25:56.477320 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:25:56.477892 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:56.483960 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:56.484398 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:56.485143 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:56.485570 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:56.507406 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8f644e12-7e4c-4c77-8163-9f24b4ea82ca tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/ips" status: 200 len: 151 microversion: 2.1 time: 0.034660 May 12 17:25:56.507952 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 491/971] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:25:56 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:25:57.805433 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73744383-8791-4a18-bdbd-87525b99d74f"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:25:57.806618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:25:57.813142 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:57.813584 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:57.814334 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:25:57.814799 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:25:58.042558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-8968adf0-470b-4a05-be3b-86597a2451bc tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241604 May 12 17:25:58.043246 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 481/972] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:25:57 2022] POST /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:04.465582 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73744383-8791-4a18-bdbd-87525b99d74f"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:04.466765 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:04.472611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:04.473058 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:04.473819 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:04.474249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:04.739754 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Invalid volume: volume 73744383-8791-4a18-bdbd-87525b99d74f is already attached to instances: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: POST /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments HTTP/1.1 May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 74 May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:26:04.741333 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {"volumeAttachment": {"volumeId": "73744383-8791-4a18-bdbd-87525b99d74f"}} May 12 17:26:04.743171 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Invalid volume: volume 73744383-8791-4a18-bdbd-87525b99d74f is already attached to instances: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'server_id': 'a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5', 'body': {'volumeAttachment': {'volumeId': '73744383-8791-4a18-bdbd-87525b99d74f'}}} May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73744383-8791-4a18-bdbd-87525b99d74f is already attached to instances: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:26:04.744160 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73744383-8791-4a18-bdbd-87525b99d74f is already attached to instances: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:26:04.749409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73744383-8791-4a18-bdbd-87525b99d74f is already attached to instances: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 400 to user: Invalid volume: volume 73744383-8791-4a18-bdbd-87525b99d74f is already attached to instances: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-006b3947-8895-42ed-9664-8f75d112dca5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.281507 May 12 17:26:04.751121 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 492/973] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:26:04 2022] POST /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments => generated 174 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:26:04.802955 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:04.803534 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:04.809667 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:04.810113 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:04.810902 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:04.811335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:04.940926 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lazy-loading 'services' on Instance uuid a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:26:05.008804 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-06889913-f0ce-49b6-857a-b3e07f7f18db tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments/73744383-8791-4a18-bdbd-87525b99d74f" status: 202 len: 0 microversion: 2.1 time: 0.210465 May 12 17:26:05.009635 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 482/974] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:26:04 2022] DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments/73744383-8791-4a18-bdbd-87525b99d74f => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:26:05.018295 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:05.019307 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:05.026612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:05.027057 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:05.027813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:05.028239 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:05.059824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d6fd357f-57ea-4b03-b210-d3353431524c tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 May 12 17:26:05.060373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 493/975] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:26:05 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:06.072618 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:06.073701 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:06.080841 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:06.081280 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:06.082210 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:06.082674 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:06.110835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-af927966-ed86-4577-acfd-198d0507f418 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042898 May 12 17:26:06.111375 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 483/976] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:26:06 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:26:06.166359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:06.166933 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:06.173213 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:06.173682 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:06.174465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:06.174904 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:06.200125 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Going to try to terminate instance {{(pid=117075) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:26:06.276008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2cb1a527-1dd5-4c30-b422-3605b22a4205 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 204 len: 0 microversion: 2.1 time: 0.113782 May 12 17:26:06.276609 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 494/977] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:26:06 2022] DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:26:06.285162 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:06.285782 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:06.292970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:06.293457 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:06.294244 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:06.294712 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:06.434708 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:06.442636 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-89d78065-bdd7-46d5-a91c-3f4116af27ed tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1682 microversion: 2.1 time: 0.161537 May 12 17:26:06.443197 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 484/978] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:06 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:26:07.461190 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:07.461910 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:07.468202 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:07.468655 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:07.469405 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:07.469839 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:07.594664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:07.602472 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6408173b-da1b-4a27-aae2-5f0f54b27eb6 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1682 microversion: 2.1 time: 0.145491 May 12 17:26:07.603045 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 495/979] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:07 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:08.620059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:08.620688 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:08.627937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:08.628386 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:08.629159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:08.629593 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:09.108322 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:09.116007 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-1695526e-ced1-4acb-87d9-1fd24606a095 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 200 len: 1682 microversion: 2.1 time: 0.500358 May 12 17:26:09.117073 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 485/980] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:08 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 1682 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:09.530234 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-e9941f6f-ae41-44c6-8e74-784993565b7a req-b59af102-2692-400c-87c8-1dbc9c4d4ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5", "name": "network-vif-deleted", "tag": "2fefabba-33b7-41b1-80f2-e0d24d8c847e"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:09.539501 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-e9941f6f-ae41-44c6-8e74-784993565b7a req-b59af102-2692-400c-87c8-1dbc9c4d4ca2 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:09.539944 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-e9941f6f-ae41-44c6-8e74-784993565b7a req-b59af102-2692-400c-87c8-1dbc9c4d4ca2 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:09.551770 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-e9941f6f-ae41-44c6-8e74-784993565b7a req-b59af102-2692-400c-87c8-1dbc9c4d4ca2 service nova] Creating event network-vif-deleted:2fefabba-33b7-41b1-80f2-e0d24d8c847e for instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 on hv-cinder-84159 May 12 17:26:09.558201 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-e9941f6f-ae41-44c6-8e74-784993565b7a req-b59af102-2692-400c-87c8-1dbc9c4d4ca2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 May 12 17:26:09.559137 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 496/981] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:10.134199 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:10.135170 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:10.141398 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:10.141854 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:10.142651 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:10.143089 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:10.158683 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 HTTP/1.1 May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:26:10.160313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:26:10.161997 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': 'a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5'} May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:26:10.162968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:26:10.164694 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:26:10.166102 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:26:10.166102 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-cbcf0562-f62e-4c13-a5ef-3e65dbf3606f tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 404 len: 111 microversion: 2.1 time: 0.032122 May 12 17:26:10.166102 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 486/982] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:10 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:26:10.171266 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-71491079-8d29-4906-a353-17188558d718 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '.version_select at 0x7f78aeb2a280>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:10.188461 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-71491079-8d29-4906-a353-17188558d718 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963410469" status: 202 len: 0 microversion: 2.1 time: 0.021414 May 12 17:26:10.189208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 497/983] 10.222.0.23 () {58 vars in 1217 bytes} [Thu May 12 17:26:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963410469 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:26:10.805291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-96b35f64-9f68-4ac6-bb15-7b0e0573d458 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: .version_select at 0x7f78af3bf940>, body: {"keypair": {"name": "tempest-keypair-63121823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslqTTB/CCnX6mbw0llfAVi144kLzJkhEFFs4kAoA0Oa9ywRDukqf5g+j+aaISh+lLLLgL2rkiFc5JBk9N//sLuCo1gcfceY8RlTOzCDJo9EGsjQZdjkeAjpHdXMl/hpw=="}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:10.820808 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-96b35f64-9f68-4ac6-bb15-7b0e0573d458 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:26:10.824539 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-96b35f64-9f68-4ac6-bb15-7b0e0573d458 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'key_pairs'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:26:10.845054 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-96b35f64-9f68-4ac6-bb15-7b0e0573d458 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044138 May 12 17:26:10.845642 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 487/984] 10.222.0.23 () {60 vars in 1158 bytes} [Thu May 12 17:26:10 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:12.113559 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1325986544", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfb02df-5940-4251-8c77-308786c51833"}], "security_groups": [{"name": "tempest-securitygroup--901793322"}], "key_name": "tempest-keypair-63121823", "user_data": "}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:12.215822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.network.neutron [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] validate_networks() for [('fcfb02df-5940-4251-8c77-308786c51833', None, None, None, None, None)] {{(pid=117075) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:26:12.566955 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:26:12.567394 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image limits 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:26:12.567857 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Flavor pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:26:12.568257 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Image pref 0:0:0 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:26:12.568660 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.virt.hardware [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117075) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:26:12.577163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:12.577600 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:12.578383 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:12.578836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:12.594709 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:26:12.598631 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.quota [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Getting quotas for user 552ba97cafec476791c9b2dbd3789936 and project fc2e1c9926c14a1393f45a7dc0346ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=117075) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:26:12.609571 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Going to run 1 instances... {{(pid=117075) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:26:12.611895 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117075) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:26:12.658491 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9fe00c21-a557-480b-9bbe-66766d831ad7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.549695 May 12 17:26:12.659124 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 498/985] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:26:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:26:12.670045 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-49b9ba3e-50c5-42b0-bcbd-8019df873893 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:12.670677 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-49b9ba3e-50c5-42b0-bcbd-8019df873893 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:12.721300 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-49b9ba3e-50c5-42b0-bcbd-8019df873893 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:12.729095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-49b9ba3e-50c5-42b0-bcbd-8019df873893 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1240 microversion: 2.1 time: 0.063251 May 12 17:26:12.729553 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 488/986] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:12 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:13.746277 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:13.747040 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:13.753982 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:13.754450 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:13.755221 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:13.755652 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:13.818186 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:13.827182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-5a39bb13-689d-4959-8537-900dd50ba738 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1310 microversion: 2.1 time: 0.085389 May 12 17:26:13.827984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 499/987] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:13 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:14.844748 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:14.845548 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:14.852200 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:14.852870 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:14.853762 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:14.854507 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:15.064146 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:15.074552 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-0af72d46-07d9-49fd-91d4-d7841f4d7194 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1365 microversion: 2.1 time: 0.233792 May 12 17:26:15.075139 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 489/988] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:14 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:15.088749 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-1c0e37c9-ea18-4a8e-8572-22ad4d42a006 req-fa4d1b80-916d-485e-a06b-c8e6df0cc426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c533fc-2ea0-48f9-847f-25f05b79aa17", "tag": "5b0baaff-7c48-48e1-8918-6c0d3d1d77d1"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:15.098611 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-1c0e37c9-ea18-4a8e-8572-22ad4d42a006 req-fa4d1b80-916d-485e-a06b-c8e6df0cc426 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:15.099135 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-1c0e37c9-ea18-4a8e-8572-22ad4d42a006 req-fa4d1b80-916d-485e-a06b-c8e6df0cc426 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:15.122513 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-1c0e37c9-ea18-4a8e-8572-22ad4d42a006 req-fa4d1b80-916d-485e-a06b-c8e6df0cc426 service nova] Creating event network-changed:5b0baaff-7c48-48e1-8918-6c0d3d1d77d1 for instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 on hv-cinder-84159 May 12 17:26:15.128241 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-1c0e37c9-ea18-4a8e-8572-22ad4d42a006 req-fa4d1b80-916d-485e-a06b-c8e6df0cc426 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048651 May 12 17:26:15.129335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 500/989] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:16.092270 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:16.092910 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:16.099391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:16.099859 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:16.100616 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:16.103328 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:16.231798 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:16.238970 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-7368d6fe-5d35-49b0-9b4a-0df91d7e3cf5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1365 microversion: 2.1 time: 0.150695 May 12 17:26:16.239528 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 490/990] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:16 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:17.256355 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:17.257086 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:17.263278 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:17.263729 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:17.264487 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:17.264916 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:17.392360 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:17.400099 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b492861e-a5b7-4e9f-a07e-facab9a51eec tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1365 microversion: 2.1 time: 0.148404 May 12 17:26:17.400664 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 501/991] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:17 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:18.417335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:18.417943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:18.424489 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:18.424937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:18.425695 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:18.426128 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:18.552078 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:18.559518 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-70c86f58-8f17-4026-bd3e-b9cabac5acfb tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1365 microversion: 2.1 time: 0.146626 May 12 17:26:18.560106 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 491/992] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:18 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:19.329852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-0abd9b77-8c30-413f-9bf1-6ee37a3bc16d req-6bd25553-80cd-4ec7-b084-a0d44b86818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c533fc-2ea0-48f9-847f-25f05b79aa17", "name": "network-vif-plugged", "status": "completed", "tag": "5b0baaff-7c48-48e1-8918-6c0d3d1d77d1"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:19.339448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-0abd9b77-8c30-413f-9bf1-6ee37a3bc16d req-6bd25553-80cd-4ec7-b084-a0d44b86818a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:19.339894 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-0abd9b77-8c30-413f-9bf1-6ee37a3bc16d req-6bd25553-80cd-4ec7-b084-a0d44b86818a service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:19.351691 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-0abd9b77-8c30-413f-9bf1-6ee37a3bc16d req-6bd25553-80cd-4ec7-b084-a0d44b86818a service nova] Creating event network-vif-plugged:5b0baaff-7c48-48e1-8918-6c0d3d1d77d1 for instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 on hv-cinder-84159 May 12 17:26:19.356776 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-0abd9b77-8c30-413f-9bf1-6ee37a3bc16d req-6bd25553-80cd-4ec7-b084-a0d44b86818a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030750 May 12 17:26:19.357359 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 502/993] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:19.577952 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:19.579095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:19.590968 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:19.591835 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:19.593228 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:19.593986 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:19.718249 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:19.725643 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9fc2c61d-a045-48b5-a794-2ffc4cc5dc67 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1365 microversion: 2.1 time: 0.153110 May 12 17:26:19.726250 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 492/994] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:19 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:20.742728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:20.743418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:20.749794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:20.750242 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:20.751013 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:20.751448 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:20.879512 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:20.887610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-af8b0c1b-b1b8-430a-bd80-3e3c1f4ecd68 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1365 microversion: 2.1 time: 0.149124 May 12 17:26:20.888173 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 503/995] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:20 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:21.904732 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:21.905336 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:21.911680 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:21.912122 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:21.912875 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:21.913343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:22.035526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:26:22.043460 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-c4b4fede-7999-4fda-abb0-7d4a58a5f556 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1555 microversion: 2.1 time: 0.142624 May 12 17:26:22.044024 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 493/996] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:26:21 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:26:22.059256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:22.059768 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:22.066075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:22.066552 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:22.067298 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:22.067724 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:22.142116 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-97842bbb-80a5-43a2-bda1-1127e744f646 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086684 May 12 17:26:22.142778 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 504/997] 10.222.0.23 () {58 vars in 1274 bytes} [Thu May 12 17:26:22 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:23.113746 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-eba81eba-eafe-42eb-8c88-df71f1dcf129 req-a5a031e8-c938-4404-b8ae-126be5f10948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c533fc-2ea0-48f9-847f-25f05b79aa17", "tag": "5b0baaff-7c48-48e1-8918-6c0d3d1d77d1"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:26:23.122800 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-eba81eba-eafe-42eb-8c88-df71f1dcf129 req-a5a031e8-c938-4404-b8ae-126be5f10948 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:23.123247 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-eba81eba-eafe-42eb-8c88-df71f1dcf129 req-a5a031e8-c938-4404-b8ae-126be5f10948 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:23.136789 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-eba81eba-eafe-42eb-8c88-df71f1dcf129 req-a5a031e8-c938-4404-b8ae-126be5f10948 service nova] Creating event network-changed:5b0baaff-7c48-48e1-8918-6c0d3d1d77d1 for instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 on hv-cinder-84159 May 12 17:26:23.141821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-eba81eba-eafe-42eb-8c88-df71f1dcf129 req-a5a031e8-c938-4404-b8ae-126be5f10948 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031896 May 12 17:26:23.142731 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 494/998] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:26:58.954901 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:26:58.955441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:26:58.961628 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:58.962106 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:58.962907 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:26:58.963354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:26:58.985891 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ddd90b13-1956-4442-8212-fda5689890c5 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/ips" status: 200 len: 150 microversion: 2.1 time: 0.035434 May 12 17:26:58.986661 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 505/999] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:26:58 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:00.289748 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22dd6e89-fed7-4536-986a-c01af5508de4"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:00.290944 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:00.297051 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:00.297494 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:00.298248 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:00.298706 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:00.534441 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-dc1fdd3d-331c-4bf1-9995-7b96928b64d3 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "POST /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249471 May 12 17:27:00.535215 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 495/1000] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:27:00 2022] POST /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:08.094158 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:08.094717 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:08.100694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:08.101139 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:08.101896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:08.102338 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:08.178189 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lazy-loading 'services' on Instance uuid 23c533fc-2ea0-48f9-847f-25f05b79aa17 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:27:08.248991 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-28c7ae97-850a-4930-99bc-6b28baa76630 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments/22dd6e89-fed7-4536-986a-c01af5508de4" status: 202 len: 0 microversion: 2.1 time: 0.158563 May 12 17:27:08.249633 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 506/1001] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:27:08 2022] DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments/22dd6e89-fed7-4536-986a-c01af5508de4 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:27:08.258504 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:08.259646 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:08.266399 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:08.266868 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:08.267645 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:08.268291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:08.297786 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-a74d076c-59e5-4f77-a4e7-c36933dda728 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043507 May 12 17:27:08.298391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 496/1002] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:27:08 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:09.311240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:09.312256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:09.318384 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:09.318852 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:09.319605 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:09.320033 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:09.347527 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-8a215034-901d-473c-ae2a-6269a57ee7b9 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041706 May 12 17:27:09.348067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 507/1003] 10.222.0.23 () {58 vars in 1301 bytes} [Thu May 12 17:27:09 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:27:09.403693 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:09.404183 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:09.410346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:09.410832 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:09.411596 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:09.412023 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:09.436407 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:27:09.508687 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-876a76e6-3f90-4aa8-88c1-1e9a838a80b2 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 204 len: 0 microversion: 2.1 time: 0.108693 May 12 17:27:09.509921 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 497/1004] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:27:09 2022] DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:27:09.518371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:09.519455 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:09.527069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:09.527591 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:09.528373 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:09.528913 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:09.657305 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:09.664794 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9b94fc65-548f-44e0-a6f2-292cd286da63 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1680 microversion: 2.1 time: 0.150363 May 12 17:27:09.665360 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 508/1005] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:09 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:10.683659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:10.684361 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:10.690739 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:10.691187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:10.691950 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:10.692381 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:10.816262 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:10.823523 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-bf8d7299-8977-4a6f-96a6-dfe02ed85e3a tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1680 microversion: 2.1 time: 0.144827 May 12 17:27:10.824087 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 498/1006] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:10 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:11.841236 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:11.841989 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:11.848330 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:11.848780 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:11.849546 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:11.849981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:11.977233 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552ba97cafec476791c9b2dbd3789936', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2e1c9926c14a1393f45a7dc0346ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:11.984644 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-2f481cbe-ac8a-491f-9f78-1f555f89e259 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 200 len: 1680 microversion: 2.1 time: 0.148107 May 12 17:27:11.985229 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 509/1007] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:11 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:12.404589 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-9e9bb82f-868e-459d-8d9b-b1dd439395ad req-1b025978-e729-4a70-be23-f881bd4573db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c533fc-2ea0-48f9-847f-25f05b79aa17", "name": "network-vif-deleted", "tag": "5b0baaff-7c48-48e1-8918-6c0d3d1d77d1"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:12.414656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9e9bb82f-868e-459d-8d9b-b1dd439395ad req-1b025978-e729-4a70-be23-f881bd4573db service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:12.415099 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-9e9bb82f-868e-459d-8d9b-b1dd439395ad req-1b025978-e729-4a70-be23-f881bd4573db service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:12.429015 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-9e9bb82f-868e-459d-8d9b-b1dd439395ad req-1b025978-e729-4a70-be23-f881bd4573db service nova] Creating event network-vif-deleted:5b0baaff-7c48-48e1-8918-6c0d3d1d77d1 for instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 on hv-cinder-84159 May 12 17:27:12.434567 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-9e9bb82f-868e-459d-8d9b-b1dd439395ad req-1b025978-e729-4a70-be23-f881bd4573db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039665 May 12 17:27:12.435343 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 499/1008] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:13.001269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:13.002710 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:13.008964 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:13.010169 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:13.011214 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:13.011643 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:13.024829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 HTTP/1.1 May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:27:13.026983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:13.028463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '23c533fc-2ea0-48f9-847f-25f05b79aa17'} May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:13.029293 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:13.030702 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:13.031995 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:13.031995 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-4514669c-f1d9-4a35-82bb-48591b7fa929 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 404 len: 111 microversion: 2.1 time: 0.031099 May 12 17:27:13.031995 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 510/1009] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:12 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:13.038268 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-da4c97bd-b9c3-44a0-af24-18c01ba04663 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '.version_select at 0x7f78af427160>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:13.055633 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-da4c97bd-b9c3-44a0-af24-18c01ba04663 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63121823" status: 202 len: 0 microversion: 2.1 time: 0.021661 May 12 17:27:13.056906 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 500/1010] 10.222.0.23 () {58 vars in 1214 bytes} [Thu May 12 17:27:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63121823 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:27:14.790108 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:14.790650 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:14.796813 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:14.797253 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:14.798007 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:14.798454 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:14.811784 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 HTTP/1.1 May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:27:14.813291 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.814954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '23c533fc-2ea0-48f9-847f-25f05b79aa17'} May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:14.815824 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.817328 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:14.818822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:14.818822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b7e5ee7f-60de-4a10-91cf-865965d23c0e tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 404 len: 111 microversion: 2.1 time: 0.028364 May 12 17:27:14.818822 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 511/1011] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:27:14 2022] DELETE /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:14.824048 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:14.824776 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 23c533fc-2ea0-48f9-847f-25f05b79aa17] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:14.830785 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:14.831237 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:14.832003 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:14.832442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:14.846135 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 HTTP/1.1 May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:27:14.847769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.849373 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '23c533fc-2ea0-48f9-847f-25f05b79aa17'} May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:14.850256 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. May 12 17:27:14.851831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:14.853469 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 23c533fc-2ea0-48f9-847f-25f05b79aa17 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:14.853469 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-440841e1-eb9c-4bc7-87e8-3ab42b7e99a8 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17" status: 404 len: 111 microversion: 2.1 time: 0.030186 May 12 17:27:14.853469 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 501/1012] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:14 2022] GET /compute/v2.1/servers/23c533fc-2ea0-48f9-847f-25f05b79aa17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:15.978574 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:15.979068 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:15.985231 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:15.985681 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:15.986451 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:15.986888 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:15.999779 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 HTTP/1.1 May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:27:16.001276 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.002896 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': 'a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5'} May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:16.003997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.005694 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.007332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:16.007332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-6c4ce03d-7289-40ff-b131-f940ef061e9d tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 404 len: 111 microversion: 2.1 time: 0.027985 May 12 17:27:16.007332 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 512/1013] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:27:15 2022] DELETE /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:16.011657 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:16.012260 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:16.018541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:16.018992 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:16.019752 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:16.020184 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:16.034043 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 HTTP/1.1 May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:27:16.035591 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.037196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': 'a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5'} May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:16.038302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. May 12 17:27:16.039850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.041356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:16.041356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-59f806aa-5fd2-45eb-bb26-0cf5452bc309 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5" status: 404 len: 111 microversion: 2.1 time: 0.029881 May 12 17:27:16.041356 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 502/1014] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:16 2022] GET /compute/v2.1/servers/a82fbd8e-77bc-4bd0-bc79-3623d2bab6d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:16.045345 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:16.045834 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:16.051685 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:16.052128 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:16.052870 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:16.053297 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:16.066727 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 HTTP/1.1 May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:27:16.068209 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.069807 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886'} May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:16.071008 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.073208 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:16.074872 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:16.074872 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-717b0a18-1f3a-4fa8-9335-de4338523474 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 404 len: 111 microversion: 2.1 time: 0.027999 May 12 17:27:16.074872 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 513/1015] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:27:16 2022] DELETE /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:27:16.078118 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:16.078774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:16.084607 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:16.085053 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:16.085809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:16.086243 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:16.109914 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 HTTP/1.1 May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:27:16.111446 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.113069 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886'} May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:16.114116 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. May 12 17:27:16.115614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:16.117018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:16.117018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-9b4c97f7-b673-458b-9cab-ff18ebee9b4b tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886" status: 404 len: 111 microversion: 2.1 time: 0.038362 May 12 17:27:16.117018 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 503/1016] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:16 2022] GET /compute/v2.1/servers/7e2bf4f6-edd7-4fe3-a55c-3c3ae4ca1886 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:17.242388 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:17.242897 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:17.249500 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:17.249938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:17.250722 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:17.251151 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:17.264686 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 HTTP/1.1 May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:27:17.266211 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.267837 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '95312fe9-ef90-4c74-ba58-31abb0fdd309'} May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:17.268832 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.270083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:17.271850 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:17.271850 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-21a877a3-7522-4813-9e0d-39ca745515b7 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 404 len: 111 microversion: 2.1 time: 0.028974 May 12 17:27:17.271850 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 514/1017] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:27:17 2022] DELETE /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:17.276492 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:17.277159 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] [instance: 95312fe9-ef90-4c74-ba58-31abb0fdd309] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:17.283443 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:17.283892 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:17.284647 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:17.285079 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:17.298257 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] HTTP exception thrown: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Request method failure captured: May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 HTTP/1.1 May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUJmiOMgcBa5FY-TYULntAH4l4KqrE24cdNP6DgPcO8R9GvUQtqhldXd75aBDVJo6IBlFLOEhlDqnFxxEvPxcKJtsoMj8DexzSOjWEnkNzV_jVp3NdvyvPGZ1VpTHOG0M1MTVLEBqPd4Wgw6q_PHiRSMwEje_lK2jrDQ27PQN7omtHk May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:27:17.299779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc2e1c9926c14a1393f45a7dc0346ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: fc2e1c9926c14a1393f45a7dc0346ddc May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95795125 May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 552ba97cafec476791c9b2dbd3789936 May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-AttachVolumeNegativeTest-95795125-project May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.301335 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': '95312fe9-ef90-4c74-ba58-31abb0fdd309'} May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:17.302288 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. May 12 17:27:17.303609 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:27:17.304860 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] Returning 404 to user: Instance 95312fe9-ef90-4c74-ba58-31abb0fdd309 could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:17.304860 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-38f7d7eb-80de-4264-ae2b-5ec7322c7790 tempest-AttachVolumeNegativeTest-95795125 tempest-AttachVolumeNegativeTest-95795125-project] 10.222.0.23 "GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309" status: 404 len: 111 microversion: 2.1 time: 0.029166 May 12 17:27:17.304860 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 504/1018] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:17 2022] GET /compute/v2.1/servers/95312fe9-ef90-4c74-ba58-31abb0fdd309 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:21.512788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-08aaea1a-72f5-480b-8363-de5b95632a46 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Action: 'create', calling method: .version_select at 0x7f78aebd2e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1587218689", "metadata": {"Type": "work"}}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:21.794395 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-08aaea1a-72f5-480b-8363-de5b95632a46 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.388588 May 12 17:27:21.795123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 515/1019] 10.222.0.23 () {60 vars in 1155 bytes} [Thu May 12 17:27:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 17:27:21.805818 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-70b58d9d-ab8e-4567-8bad-714213626eb3 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Calling method '.version_select at 0x7f78afdb4790>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:21.855027 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-70b58d9d-ab8e-4567-8bad-714213626eb3 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18" status: 200 len: 353 microversion: 2.1 time: 0.052985 May 12 17:27:21.855603 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 505/1020] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:27:21 2022] GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:27:22.867465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-fdb5f845-2878-4876-b085-6cff42cca56b tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Calling method '.version_select at 0x7f78aea4a700>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:22.913259 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-fdb5f845-2878-4876-b085-6cff42cca56b tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18" status: 200 len: 354 microversion: 2.1 time: 0.050072 May 12 17:27:22.913823 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 516/1021] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:27:22 2022] GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:22.925620 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3f8333d3-dd4c-4843-b716-9ca49441bc64 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Calling method '.version_select at 0x7f78afdb9c10>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:22.970948 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3f8333d3-dd4c-4843-b716-9ca49441bc64 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18" status: 200 len: 354 microversion: 2.1 time: 0.049475 May 12 17:27:22.971637 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 506/1022] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:27:22 2022] GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:22.988281 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f5c228b5-d018-4e72-aaff-ab5ef6966a82 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Calling method '.version_select at 0x7f78aeaad670>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:23.046078 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f5c228b5-d018-4e72-aaff-ab5ef6966a82 tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18" status: 202 len: 0 microversion: 2.1 time: 0.061604 May 12 17:27:23.046680 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 517/1023] 10.222.0.23 () {58 vars in 1247 bytes} [Thu May 12 17:27:22 2022] DELETE /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:27:23.054763 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-17bf568d-6788-4a2f-bd68-3c1e2a7c57de tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Calling method '.version_select at 0x7f78af368700>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:23.101318 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-17bf568d-6788-4a2f-bd68-3c1e2a7c57de tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18" status: 200 len: 353 microversion: 2.1 time: 0.050338 May 12 17:27:23.101885 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 507/1024] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:27:23 2022] GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:24.114998 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9eb46133-dc83-4022-8fd8-7230eb4fb45e tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Calling method '.version_select at 0x7f78aeafb820>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:24.141129 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-9eb46133-dc83-4022-8fd8-7230eb4fb45e tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] HTTP exception thrown: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9eb46133-dc83-4022-8fd8-7230eb4fb45e tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Request method failure captured: May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 HTTP/1.1 May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUN5_i5ukjDgUQ-JsqO0N58RZdxfd9KVn6Gcs5ISY5ghV8l2Jtrl7QOSA_HjocHoqJ1ZDImyyNpvkkZsDy1UQNchtHGmLmkImjXdmU5ay5ieVSZTmNTsYGjbqGses96Tvivel7RMb5qsIhN0Zu2x7LCaOLymrHZH78BPuMLXdjPhCK4 May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: eb8edc4015e0493699c1cb2df935106b May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesGetTestJSON-979566642 May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:27:24.143092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb8edc4015e0493699c1cb2df935106b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eb8edc4015e0493699c1cb2df935106b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eb8edc4015e0493699c1cb2df935106b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eb8edc4015e0493699c1cb2df935106b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesGetTestJSON-979566642 May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: eb8edc4015e0493699c1cb2df935106b May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesGetTestJSON-979566642 May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesGetTestJSON-979566642-project May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 3c837f4a10f8435284112014c0b7d549 May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesGetTestJSON-979566642-project May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '7e76b369-003c-4ab7-8908-53519c584d18'} May 12 17:27:24.144766 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. (HTTP 404) (Request-ID: req-94dc63cd-febd-4e45-b995-5e8d71cadac7) May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:24.145798 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:27:24.147371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:27:24.148825 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9eb46133-dc83-4022-8fd8-7230eb4fb45e tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] Returning 404 to user: Volume 7e76b369-003c-4ab7-8908-53519c584d18 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9eb46133-dc83-4022-8fd8-7230eb4fb45e tempest-VolumesGetTestJSON-979566642 tempest-VolumesGetTestJSON-979566642-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18" status: 404 len: 109 microversion: 2.1 time: 0.033890 May 12 17:27:24.150204 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 518/1025] 10.222.0.23 () {58 vars in 1244 bytes} [Thu May 12 17:27:24 2022] GET /compute/v2.1/os-volumes/7e76b369-003c-4ab7-8908-53519c584d18 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:27:32.802224 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1896341969", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "networks": [{"uuid": "94d33038-e6e0-48de-a3e8-1202c82fbf05"}]}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:32.852781 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] validate_networks() for [('94d33038-e6e0-48de-a3e8-1202c82fbf05', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:27:33.195384 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:27:33.195855 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:27:33.196319 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:27:33.196720 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:27:33.197119 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:27:33.207196 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:33.207629 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:33.208416 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:33.208843 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:33.224656 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Getting quotas for project b8d06acefd19481b807f3d525bd735c7. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:27:33.228994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Getting quotas for user 737d22a7ee7246b9a1b1a9dc5fbb3ce0 and project b8d06acefd19481b807f3d525bd735c7. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:27:33.239236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:27:33.241412 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:27:33.286478 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-5ddb0bc7-e301-4795-a3fa-67e8bc6885cf tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488435 May 12 17:27:33.287236 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 508/1026] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:27:33.300290 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1730611b-6755-4843-b995-c61769a3c050 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:33.301026 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1730611b-6755-4843-b995-c61769a3c050 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:33.352454 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1730611b-6755-4843-b995-c61769a3c050 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:33.359477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1730611b-6755-4843-b995-c61769a3c050 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1219 microversion: 2.1 time: 0.063625 May 12 17:27:33.359997 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 519/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:33 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:34.377114 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:34.377704 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:34.383879 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:34.384331 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:34.385926 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:34.386353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:34.446071 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:34.453261 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2e0799bd-6c7d-453f-9c78-09bbdfd10e09 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1223 microversion: 2.1 time: 0.080617 May 12 17:27:34.453809 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 509/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:34 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:35.469859 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:35.470477 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:35.476441 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:35.476887 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:35.477662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:35.478104 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:35.542075 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:35.549663 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-f33ef5a3-160f-41ee-bf56-bf9c3a34ff6c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1277 microversion: 2.1 time: 0.083860 May 12 17:27:35.550224 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 520/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:35 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:36.566358 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-2373c752-5c09-4c3a-a397-5bc0208d7152 req-427de193-6d24-4394-a712-6a4af99ea090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63170457-206f-4bd2-bb81-ca6929aa0412", "tag": "aed72da4-d6b2-4491-b6ee-d0941c9b036f"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:36.567074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:36.567788 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:36.575194 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:36.576069 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:36.576408 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:36.576874 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:36.582313 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2373c752-5c09-4c3a-a397-5bc0208d7152 req-427de193-6d24-4394-a712-6a4af99ea090 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:36.582774 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-2373c752-5c09-4c3a-a397-5bc0208d7152 req-427de193-6d24-4394-a712-6a4af99ea090 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:36.596095 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-2373c752-5c09-4c3a-a397-5bc0208d7152 req-427de193-6d24-4394-a712-6a4af99ea090 service nova] Creating event network-changed:aed72da4-d6b2-4491-b6ee-d0941c9b036f for instance 63170457-206f-4bd2-bb81-ca6929aa0412 on hv-cinder-84159 May 12 17:27:36.609470 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-2373c752-5c09-4c3a-a397-5bc0208d7152 req-427de193-6d24-4394-a712-6a4af99ea090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047564 May 12 17:27:36.610353 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 510/1030] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:36.705465 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:36.713222 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-ea99b874-f149-45bf-b317-7b9523809dd7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.149454 May 12 17:27:36.713780 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 521/1031] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:36 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:27:37.730622 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:37.731350 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:37.737448 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:37.737894 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:37.738676 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:37.739111 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:37.900842 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:37.908129 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-788d4822-c445-49f1-90aa-e59dd4f7d34d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.182733 May 12 17:27:37.908696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 511/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:37 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:38.925748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:38.926354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:38.933256 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:38.933706 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:38.934483 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:38.934920 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:39.060059 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:39.067269 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-1188b340-3745-4233-913e-b5bdeeb4763a tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.146077 May 12 17:27:39.068020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 522/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:38 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:40.084032 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:40.084754 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:40.091351 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:40.091800 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:40.092567 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:40.093004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:40.216592 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:40.223778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-6a7b6f32-8ee6-431c-bcbe-bacc5bc065f9 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.143710 May 12 17:27:40.224347 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 512/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:40 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:41.240422 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:41.241053 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:41.247629 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:41.248070 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:41.248820 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:41.249240 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:41.374406 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:41.381507 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b530d586-03d9-4f31-a0da-b30563e3d423 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.144930 May 12 17:27:41.382065 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 523/1035] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:41 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:41.850658 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-bb257d9f-0004-434e-bdf1-c8fc38449607 req-ee2a0bfa-5b15-42d1-9e90-baafe1dd3f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63170457-206f-4bd2-bb81-ca6929aa0412", "name": "network-vif-plugged", "status": "completed", "tag": "aed72da4-d6b2-4491-b6ee-d0941c9b036f"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:41.858473 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-bb257d9f-0004-434e-bdf1-c8fc38449607 req-ee2a0bfa-5b15-42d1-9e90-baafe1dd3f56 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:41.858919 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-bb257d9f-0004-434e-bdf1-c8fc38449607 req-ee2a0bfa-5b15-42d1-9e90-baafe1dd3f56 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:41.869831 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-bb257d9f-0004-434e-bdf1-c8fc38449607 req-ee2a0bfa-5b15-42d1-9e90-baafe1dd3f56 service nova] Creating event network-vif-plugged:aed72da4-d6b2-4491-b6ee-d0941c9b036f for instance 63170457-206f-4bd2-bb81-ca6929aa0412 on hv-cinder-84159 May 12 17:27:41.874701 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-bb257d9f-0004-434e-bdf1-c8fc38449607 req-ee2a0bfa-5b15-42d1-9e90-baafe1dd3f56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142566 May 12 17:27:41.875281 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 513/1036] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:27:42.398663 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:42.399225 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:42.406153 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:42.406654 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:42.407418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:42.407850 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:42.534612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:42.542368 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c0d5c06d-615e-41a3-9d90-8f529848fea8 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.147727 May 12 17:27:42.542956 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 524/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:42 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:43.560427 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:43.561132 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:43.567315 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:43.567812 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:43.568546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:43.568983 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:43.698949 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:43.706127 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2cb24a31-5380-411f-b505-53ee4946ef1f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1319 microversion: 2.1 time: 0.151069 May 12 17:27:43.706729 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 514/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:43 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:44.722954 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:27:44.723566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:44.729882 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:44.730342 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:44.731130 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:44.731566 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:44.854347 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:27:44.861631 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e96ebcc4-e503-4b2b-98f8-9677390ea58d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1507 microversion: 2.1 time: 0.142491 May 12 17:27:44.862225 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 525/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:27:44 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1507 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:27:59.936526 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdd8cb38-157a-4505-b617-0ae763a501ed", "device": "/dev/sdb"}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:27:59.938077 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:27:59.944059 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:59.944509 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:27:59.945266 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:27:59.945696 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:00.173368 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-d823c1d7-ffd7-4f5f-a5f3-d43f4dd8b918 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "POST /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240625 May 12 17:28:00.173998 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 515/1040] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:27:59 2022] POST /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:28:21.643319 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:21.643795 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:21.649497 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:21.649935 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:21.650707 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:21.651134 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:21.730432 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lazy-loading 'services' on Instance uuid 63170457-206f-4bd2-bb81-ca6929aa0412 {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:28:21.798214 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-c094b210-d9eb-4f13-bcc7-5896bc5fc75d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412/os-volume_attachments/cdd8cb38-157a-4505-b617-0ae763a501ed" status: 202 len: 0 microversion: 2.1 time: 0.158782 May 12 17:28:21.798829 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 526/1041] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:28:21 2022] DELETE /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412/os-volume_attachments/cdd8cb38-157a-4505-b617-0ae763a501ed => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:28:22.915866 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:22.916918 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:22.923434 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:22.923886 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:22.924654 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:22.925090 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:22.949989 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Going to try to terminate instance {{(pid=117074) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:28:23.022187 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b47272f4-2129-4da5-adce-a12781ef391d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 204 len: 0 microversion: 2.1 time: 0.112034 May 12 17:28:23.023009 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 516/1042] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:28:22 2022] DELETE /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:28:23.033886 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:23.034676 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:23.041697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:23.042354 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:23.043233 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:23.044156 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:23.173520 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:23.180748 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-d64c074e-8f88-4e73-93a9-bab8c6d1394d tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1513 microversion: 2.1 time: 0.152673 May 12 17:28:23.181249 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 527/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:23 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:28:24.199622 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:24.200285 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:24.206953 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:24.207402 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:24.208190 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:24.208623 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:24.338607 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:24.346597 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-78fd35ec-7817-4f60-ad0a-c92a54bc1eb6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1513 microversion: 2.1 time: 0.151869 May 12 17:28:24.347171 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 517/1044] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:24 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:25.336177 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-943dd2d7-35a4-4f1e-b276-38d69b6d41f5 req-1dec3393-9de4-42b9-99f9-de6a9e59a2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63170457-206f-4bd2-bb81-ca6929aa0412", "name": "network-vif-deleted", "tag": "aed72da4-d6b2-4491-b6ee-d0941c9b036f"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:28:25.344903 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-943dd2d7-35a4-4f1e-b276-38d69b6d41f5 req-1dec3393-9de4-42b9-99f9-de6a9e59a2bb service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:25.345340 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-943dd2d7-35a4-4f1e-b276-38d69b6d41f5 req-1dec3393-9de4-42b9-99f9-de6a9e59a2bb service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:25.356178 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-943dd2d7-35a4-4f1e-b276-38d69b6d41f5 req-1dec3393-9de4-42b9-99f9-de6a9e59a2bb service nova] Creating event network-vif-deleted:aed72da4-d6b2-4491-b6ee-d0941c9b036f for instance 63170457-206f-4bd2-bb81-ca6929aa0412 on hv-cinder-84159 May 12 17:28:25.361425 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-943dd2d7-35a4-4f1e-b276-38d69b6d41f5 req-1dec3393-9de4-42b9-99f9-de6a9e59a2bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143783 May 12 17:28:25.361990 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 528/1045] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:28:25.364540 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:25.364913 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:25.371120 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:25.371572 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:25.372346 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:25.372792 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:25.403576 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:25.403959 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:25.404406 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lazy-loading 'fault' on Instance uuid 63170457-206f-4bd2-bb81-ca6929aa0412 {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:28:25.443442 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:25.451085 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-ee7a0dd6-8173-4098-887f-efc2b4e1eec2 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 200 len: 1309 microversion: 2.1 time: 0.090863 May 12 17:28:25.451685 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 518/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:25 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:28:26.469662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:26.470267 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: 63170457-206f-4bd2-bb81-ca6929aa0412] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:26.476369 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:26.476818 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:26.477568 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:26.478000 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:26.491356 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.wsgi [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] HTTP exception thrown: Instance 63170457-206f-4bd2-bb81-ca6929aa0412 could not be found. May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Request method failure captured: May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: request: GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 HTTP/1.1 May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept: application/json May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Accept-Encoding: identity May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Connection: close May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Length: 0 May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Content-Type: application/json May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Host: 10.222.0.23 May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Openstack-System-Scope: None May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: User-Agent: python-urllib3/1.26.9 May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Auth-Token: gAAAAABifUODBf3F8BFOYYp9k09GwZDymY1mhKGHcee91KCsCv--F_xgdFK4J65FxBbIEfxLGHwuPs9-XAgBSw7T-ieiGa2l24QSVZbnx4XXRqieNyHjatPfqrRgLwc0sLKiXqsdqGcDf5vc28LpyK6NCeOrnvyadQr9wTsCtPZC8ASmKjPTsAA May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Id: None May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Domain-Name: None May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Identity-Status: Confirmed May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Is-Admin-Project: True May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Id: default May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Domain-Name: Default May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Id: b8d06acefd19481b807f3d525bd735c7 May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Project-Name: tempest-VolumesSnapshotTestJSON-607785975 May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Role: member,reader May 12 17:28:26.492923 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Roles: member,reader May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant: tempest-VolumesSnapshotTestJSON-607785975 May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Id: b8d06acefd19481b807f3d525bd735c7 May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-607785975 May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User: tempest-VolumesSnapshotTestJSON-607785975-project May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Id: default May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Domain-Name: Default May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Id: 737d22a7ee7246b9a1b1a9dc5fbb3ce0 May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: X-User-Name: tempest-VolumesSnapshotTestJSON-607785975-project May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: method: > May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: exception: Instance 63170457-206f-4bd2-bb81-ca6929aa0412 could not be found. May 12 17:28:26.494642 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: action_args: {'id': '63170457-206f-4bd2-bb81-ca6929aa0412'} May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63170457-206f-4bd2-bb81-ca6929aa0412 could not be found. May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:28:26.495845 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63170457-206f-4bd2-bb81-ca6929aa0412 could not be found. May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63170457-206f-4bd2-bb81-ca6929aa0412 could not be found. May 12 17:28:26.497593 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: ERROR nova.api.openstack.wsgi May 12 17:28:26.499182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Returning 404 to user: Instance 63170457-206f-4bd2-bb81-ca6929aa0412 could not be found. {{(pid=117075) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:28:26.499182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-3d05fe41-c925-41f4-8a12-cb1004762056 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412" status: 404 len: 111 microversion: 2.1 time: 0.029895 May 12 17:28:26.499182 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 529/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:26 2022] GET /compute/v2.1/servers/63170457-206f-4bd2-bb81-ca6929aa0412 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:28:34.229207 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-494677402", "imageRef": "a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0", "flavorRef": "452", "networks": [{"uuid": "94d33038-e6e0-48de-a3e8-1202c82fbf05"}]}} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:28:34.279401 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.network.neutron [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] validate_networks() for [('94d33038-e6e0-48de-a3e8-1202c82fbf05', None, None, None, None, None)] {{(pid=117074) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:28:34.675943 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Flavor limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:28:34.676391 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Image limits 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:28:34.676856 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Flavor pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:28:34.677291 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Image pref 0:0:0 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:28:34.677698 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.virt.hardware [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:28:34.687067 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:34.687447 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:34.688234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:34.688659 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:34.704393 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Getting quotas for project b8d06acefd19481b807f3d525bd735c7. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:28:34.708201 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.quota [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Getting quotas for user 737d22a7ee7246b9a1b1a9dc5fbb3ce0 and project b8d06acefd19481b807f3d525bd735c7. Resources: {'ram', 'cores', 'instances'} {{(pid=117074) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:28:34.719062 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Going to run 1 instances... {{(pid=117074) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:28:34.721234 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0c64ae5-6db7-4aef-82e1-6a5c4a3748a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:28:34.768853 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-3415a572-6d4c-49e0-a0cd-d1c68f1a838c tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543301 May 12 17:28:34.769499 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 519/1048] 10.222.0.23 () {60 vars in 1146 bytes} [Thu May 12 17:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:28:34.779981 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-755a5e8f-a386-4dfa-beec-7196e5a0f1e6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:34.780710 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-755a5e8f-a386-4dfa-beec-7196e5a0f1e6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:34.832191 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-755a5e8f-a386-4dfa-beec-7196e5a0f1e6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:34.838612 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-755a5e8f-a386-4dfa-beec-7196e5a0f1e6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1218 microversion: 2.1 time: 0.063145 May 12 17:28:34.839177 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 530/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:34 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:35.856275 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:35.856916 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:35.866790 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:35.867477 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:35.868400 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:35.869004 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:35.944521 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:35.952068 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f1c64354-35aa-4e9e-ba26-ee19837558c1 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1276 microversion: 2.1 time: 0.100085 May 12 17:28:35.952725 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 520/1050] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:35 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:36.959492 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-e4adcd9d-0190-4926-a3a3-b32db661438d req-80c72a2e-bc38-4756-8771-6c9ed5d1cb1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f28bca-f96c-4fb9-993b-a8f20861382c", "tag": "b9ecbbce-08d9-4d02-9d0f-91ab232d9586"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:28:36.970737 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:36.971323 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-e4adcd9d-0190-4926-a3a3-b32db661438d req-80c72a2e-bc38-4756-8771-6c9ed5d1cb1e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:36.971558 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:36.971697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-e4adcd9d-0190-4926-a3a3-b32db661438d req-80c72a2e-bc38-4756-8771-6c9ed5d1cb1e service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:36.980905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:36.981674 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:36.982994 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:36.983123 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-e4adcd9d-0190-4926-a3a3-b32db661438d req-80c72a2e-bc38-4756-8771-6c9ed5d1cb1e service nova] Creating event network-changed:b9ecbbce-08d9-4d02-9d0f-91ab232d9586 for instance f7f28bca-f96c-4fb9-993b-a8f20861382c on hv-cinder-84159 May 12 17:28:36.983769 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:36.987812 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-e4adcd9d-0190-4926-a3a3-b32db661438d req-80c72a2e-bc38-4756-8771-6c9ed5d1cb1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032411 May 12 17:28:36.988404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 531/1051] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:28:37.460226 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:37.467364 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-b760177c-50ba-43b1-87f6-0a58506f65dc tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1318 microversion: 2.1 time: 0.501571 May 12 17:28:37.467951 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 521/1052] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:36 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:38.485042 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:38.485679 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:38.491782 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:38.492227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:38.492983 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:38.493418 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:38.623576 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:38.630671 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-e5328a28-1732-4246-82d2-77795e4f4713 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1318 microversion: 2.1 time: 0.150376 May 12 17:28:38.631227 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 532/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:38 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:39.647931 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:39.648541 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:39.655395 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:39.655848 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:39.656615 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:39.657050 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:39.779965 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:39.787185 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-2a9ce2ac-f249-46d9-8d3d-b6ccb89859c7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1318 microversion: 2.1 time: 0.143182 May 12 17:28:39.787754 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 522/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:39 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:40.803880 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:40.804484 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:40.810751 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:40.811187 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:40.811932 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:40.812360 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:40.950580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:40.958133 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-0c79265f-6d03-4451-b2db-35a6748d4afe tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1318 microversion: 2.1 time: 0.158078 May 12 17:28:40.960382 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 533/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:40 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:41.975302 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:41.976055 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:41.983195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:41.983649 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:41.984409 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:41.984842 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:42.020716 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [req-32216886-b32b-4738-9d43-6cc88ef4b257 req-f5a49a45-bb95-4c26-ae98-19201517f958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f28bca-f96c-4fb9-993b-a8f20861382c", "name": "network-vif-plugged", "status": "completed", "tag": "b9ecbbce-08d9-4d02-9d0f-91ab232d9586"}]} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:28:42.030084 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-32216886-b32b-4738-9d43-6cc88ef4b257 req-f5a49a45-bb95-4c26-ae98-19201517f958 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:42.030635 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [req-32216886-b32b-4738-9d43-6cc88ef4b257 req-f5a49a45-bb95-4c26-ae98-19201517f958 service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:42.041662 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.compute.server_external_events [req-32216886-b32b-4738-9d43-6cc88ef4b257 req-f5a49a45-bb95-4c26-ae98-19201517f958 service nova] Creating event network-vif-plugged:b9ecbbce-08d9-4d02-9d0f-91ab232d9586 for instance f7f28bca-f96c-4fb9-993b-a8f20861382c on hv-cinder-84159 May 12 17:28:42.047187 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [req-32216886-b32b-4738-9d43-6cc88ef4b257 req-f5a49a45-bb95-4c26-ae98-19201517f958 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 May 12 17:28:42.047792 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 534/1056] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:28:42.122030 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:42.129259 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-f32d3bd8-7c0b-4fa1-aacd-0e119fa7acf7 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1318 microversion: 2.1 time: 0.157924 May 12 17:28:42.129821 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 523/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:41 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:43.147335 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:43.148055 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:43.154162 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:43.154648 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:43.155407 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:43.155836 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:43.283902 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:43.292583 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-906ba0aa-fc2b-4b3b-a9d1-f50a1042fd01 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1318 microversion: 2.1 time: 0.149891 May 12 17:28:43.293157 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 535/1058] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:43 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:28:44.309881 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:28:44.310516 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:44.317745 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:44.318230 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:44.319031 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:44.319480 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:44.443784 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:28:44.450938 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-60ce46ec-5b2c-4668-9643-b8be201876e3 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1506 microversion: 2.1 time: 0.145640 May 12 17:28:44.451501 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 524/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:28:44 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:28:44.467485 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87f70fc6-6c8c-4be3-b758-92627d444a88", "device": "/dev/sdb"}} {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:28:44.469017 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:28:44.475270 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:44.475714 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:44.476469 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:28:44.476898 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:28:44.851371 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-b7750fe1-43dd-4f72-9bd3-a743c396a6da tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "POST /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388138 May 12 17:28:44.851984 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 536/1060] 10.222.0.23 () {60 vars in 1322 bytes} [Thu May 12 17:28:44 2022] POST /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:29:00.982001 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:29:00.982522 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:29:00.988319 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:00.988778 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:00.989546 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:00.989979 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:01.074445 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.objects.instance [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lazy-loading 'services' on Instance uuid f7f28bca-f96c-4fb9-993b-a8f20861382c {{(pid=117074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:29:01.141909 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-adf77be9-b19d-44a8-a974-315627036124 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c/os-volume_attachments/87f70fc6-6c8c-4be3-b758-92627d444a88" status: 202 len: 0 microversion: 2.1 time: 0.164403 May 12 17:29:01.142498 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 525/1061] 10.222.0.23 () {58 vars in 1415 bytes} [Thu May 12 17:29:00 2022] DELETE /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c/os-volume_attachments/87f70fc6-6c8c-4be3-b758-92627d444a88 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:29:02.249150 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:29:02.249728 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:29:02.255735 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:02.256183 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:02.256938 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:02.257370 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:02.281083 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Going to try to terminate instance {{(pid=117075) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:29:02.351496 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-9aa1ba99-98d3-4d76-97d9-bb8199369a52 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 204 len: 0 microversion: 2.1 time: 0.107361 May 12 17:29:02.352074 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 537/1062] 10.222.0.23 () {58 vars in 1238 bytes} [Thu May 12 17:29:02 2022] DELETE /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:29:02.362011 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:29:02.362742 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:29:02.368833 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:02.369285 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:02.370050 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:02.370517 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:02.504480 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.policy [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117074) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:29:02.512531 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-54bb23a3-c9fc-4398-88fe-156e9bb972d6 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1512 microversion: 2.1 time: 0.155223 May 12 17:29:02.513253 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 526/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:29:02 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:29:03.529703 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:29:03.530404 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:29:03.536697 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:03.537139 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:03.537893 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:03.538321 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:03.661409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:29:03.668610 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-80419a56-37c1-49ef-baf4-bb3d45944d56 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1512 microversion: 2.1 time: 0.143178 May 12 17:29:03.669163 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 538/1064] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:29:03 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:29:04.450747 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [req-ac156f69-8624-4f01-8e20-d638d75dad08 req-eb73ba1f-6519-482f-9bf6-ae4ddad12f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f28bca-f96c-4fb9-993b-a8f20861382c", "name": "network-vif-deleted", "tag": "b9ecbbce-08d9-4d02-9d0f-91ab232d9586"}]} {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:29:04.461937 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ac156f69-8624-4f01-8e20-d638d75dad08 req-eb73ba1f-6519-482f-9bf6-ae4ddad12f7b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:04.462577 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [req-ac156f69-8624-4f01-8e20-d638d75dad08 req-eb73ba1f-6519-482f-9bf6-ae4ddad12f7b service nova] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:04.476120 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.compute.server_external_events [req-ac156f69-8624-4f01-8e20-d638d75dad08 req-eb73ba1f-6519-482f-9bf6-ae4ddad12f7b service nova] Creating event network-vif-deleted:b9ecbbce-08d9-4d02-9d0f-91ab232d9586 for instance f7f28bca-f96c-4fb9-993b-a8f20861382c on hv-cinder-84159 May 12 17:29:04.481791 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [req-ac156f69-8624-4f01-8e20-d638d75dad08 req-eb73ba1f-6519-482f-9bf6-ae4ddad12f7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034826 May 12 17:29:04.482449 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 527/1065] 10.222.0.23 () {64 vars in 1317 bytes} [Thu May 12 17:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:29:04.736443 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.api.openstack.wsgi [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117075) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:29:04.737027 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.compute.api [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117075) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:29:04.743218 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:04.743667 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:04.744420 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:04.744854 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:04.775020 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:04.775463 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG oslo_concurrency.lockutils [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117075) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:04.775900 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.objects.instance [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lazy-loading 'fault' on Instance uuid f7f28bca-f96c-4fb9-993b-a8f20861382c {{(pid=117075) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:29:04.817656 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: DEBUG nova.policy [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737d22a7ee7246b9a1b1a9dc5fbb3ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d06acefd19481b807f3d525bd735c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117075) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:29:04.824785 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO nova.api.openstack.requestlog [None req-44eb3e80-9f3e-45b7-a5d0-f16d2924ed14 tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 200 len: 1308 microversion: 2.1 time: 0.092440 May 12 17:29:04.825337 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: [pid: 117075|app: 0|req: 539/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:29:04 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:29:05.843905 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Calling method '>' {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:29:05.844614 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.compute.api [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] [instance: f7f28bca-f96c-4fb9-993b-a8f20861382c] Fetching instance by UUID {{(pid=117074) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:29:05.851195 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:05.851648 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:05.852414 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:29:05.852850 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG oslo_concurrency.lockutils [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Lock "d2df521c-6c27-48b0-b2f1-a0a30efe8016" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:29:05.865873 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.wsgi [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] HTTP exception thrown: Instance f7f28bca-f96c-4fb9-993b-a8f20861382c could not be found. May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Request method failure captured: May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: request: GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c HTTP/1.1 May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept: application/json May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Accept-Encoding: identity May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Connection: close May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Length: 0 May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Content-Type: application/json May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Host: 10.222.0.23 May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Openstack-System-Scope: None May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: User-Agent: python-urllib3/1.26.9 May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Auth-Token: gAAAAABifUODBf3F8BFOYYp9k09GwZDymY1mhKGHcee91KCsCv--F_xgdFK4J65FxBbIEfxLGHwuPs9-XAgBSw7T-ieiGa2l24QSVZbnx4XXRqieNyHjatPfqrRgLwc0sLKiXqsdqGcDf5vc28LpyK6NCeOrnvyadQr9wTsCtPZC8ASmKjPTsAA May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Id: None May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Domain-Name: None May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Identity-Status: Confirmed May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Is-Admin-Project: True May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Id: default May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Domain-Name: Default May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Id: b8d06acefd19481b807f3d525bd735c7 May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Project-Name: tempest-VolumesSnapshotTestJSON-607785975 May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Role: member,reader May 12 17:29:05.867550 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Roles: member,reader May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b8d06acefd19481b807f3d525bd735c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant: tempest-VolumesSnapshotTestJSON-607785975 May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Id: b8d06acefd19481b807f3d525bd735c7 May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-607785975 May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User: tempest-VolumesSnapshotTestJSON-607785975-project May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Id: default May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Domain-Name: Default May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Id: 737d22a7ee7246b9a1b1a9dc5fbb3ce0 May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: X-User-Name: tempest-VolumesSnapshotTestJSON-607785975-project May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: method: > May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: exception: Instance f7f28bca-f96c-4fb9-993b-a8f20861382c could not be found. May 12 17:29:05.869086 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: action_args: {'id': 'f7f28bca-f96c-4fb9-993b-a8f20861382c'} May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: {{(pid=117074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f28bca-f96c-4fb9-993b-a8f20861382c could not be found. May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:29:05.869899 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f28bca-f96c-4fb9-993b-a8f20861382c could not be found. May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f28bca-f96c-4fb9-993b-a8f20861382c could not be found. May 12 17:29:05.871389 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: ERROR nova.api.openstack.wsgi May 12 17:29:05.872904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: DEBUG nova.api.openstack.wsgi [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] Returning 404 to user: Instance f7f28bca-f96c-4fb9-993b-a8f20861382c could not be found. {{(pid=117074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:29:05.872904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO nova.api.openstack.requestlog [None req-287ab178-5ac2-486e-9323-ef1b63fb384f tempest-VolumesSnapshotTestJSON-607785975 tempest-VolumesSnapshotTestJSON-607785975-project] 10.222.0.23 "GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c" status: 404 len: 111 microversion: 2.1 time: 0.029958 May 12 17:29:05.872904 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: [pid: 117074|app: 0|req: 528/1067] 10.222.0.23 () {58 vars in 1235 bytes} [Thu May 12 17:29:05 2022] GET /compute/v2.1/servers/f7f28bca-f96c-4fb9-993b-a8f20861382c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:29:22.165067 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:29:22.165580 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Thu May 12 17:29:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:29:54.958491 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:29:54.959019 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Thu May 12 17:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:31:02.514673 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:31:02.515357 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Thu May 12 17:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:31:16.511410 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:31:16.512014 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Thu May 12 17:31:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:31:18.930092 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:31:18.930675 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Thu May 12 17:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:31:31.323779 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:31:31.324246 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Thu May 12 17:31:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:32:42.176216 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:32:42.177409 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Thu May 12 17:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:33:14.967024 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:33:14.967540 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Thu May 12 17:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:34:22.524040 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:34:22.524749 dv-cinder-841591-1-iscsi devstack@n-api.service[117074]: Thu May 12 17:34:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:34:36.521056 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:34:36.521632 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Thu May 12 17:34:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:34:38.939298 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:34:38.939946 dv-cinder-841591-1-iscsi devstack@n-api.service[117075]: Thu May 12 17:34:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!